Towards Soft-Prompt Tuning with Large Language Models | Vector Applied Intern Talks

Saeed’s talk examines a recent method for prompt engineering with large language models. During the internship, Saeed provided a reference implementation and experimentation framework based on PyTorch and HuggingFace for soft-prompt tuning with T5-large language models.
The implementation serves as a prototype or proof-of-concept for future development toward the large-scale application of soft-prompt tuning in language models. The preliminary experiment conducted on sentiment analysis tasks was promising.

Do you want to gain hands-on ML experience? Explore Vector’s internship opportunities: https://vectorinstitute.ai/internships/

Link from Video
https://github.com/google-research/pr...

Git Hub
https://github.com/orgs/VectorInstitu...