Скачать или смотреть Maintaining Consistency: Annotation Guideline Management for Digital and Voice Bots

Presented by Women Who Code Boston
Speaker: Cheyanne Baird
Topic: Maintaining Consistency: Annotation Guideline Management for Digital and Voice Bots

Consistency is key when it comes to labeling data. At Posh, our digital and voice bots in the financial domain consist of many context-dependent turns of dialogue. The complexity of our data requires human annotators to follow a set of clear guidelines to help ensure consistency and high inter-annotator agreement. In this talk, I'll walk you through the steps of writing guidelines for an annotation task.

Overview: Posh's Prodigy cloud annotation service
Writing Guidelines: Where to Begin?
Maintenance and Quality-Control: Dealing with Subjective and Contextual Content
Looking to the Future: Generating Examples and Labeling Data using GPT-3

For our slack channel, previous event recordings, 🗓 upcoming events, github repo and more check us out on https://www.womenwhocode.com/boston
___
💻 WWCode Digital Events: https://www.womenwhocode.com/events
🔎 Job Board: https://www.womenwhocode.com/jobs​​​​
💌 Make a Donation: https://www.womenwhocode.com/donate