Location:
Seattle, Washington

Type:

Contract

Job #1262

We are looking for a skilled Linguistic Engineer to join our team and maintain the data in our LLM data grading and analysis pipelines. In this role, you will be instrumental in assessing the quality of data processed by our LLM systems. Using new and existing data quality workflows and pipelines, you will collaborate closely with a cross functional team of engineers, research scientists, project managers, and data scientists to report on and guide improvements on our LLM powered features, ensuring their accuracy and reliability in smart glasses applications.

Job Responsibilities:

• Maintain production data grading queues, report on product and annotation quality, perform data analysis using SQL, Python, and spreadsheets.

* Guide your analyses using linguistic expertise in the areas of phonetics, phonology, dialectology, and NLP.

• Design and conduct experiments for evaluating rater quality, inter-rater reliability; write summary reports based on findings and speak on those findings in meetings.

• Develop manual and automated processes for multiple concurrent projects ensuring high-quality labeled data.

• Create and perfect LLM Quality grading queues and LLM related component quality error attribution grading queues.

• Build datasets and write guidelines in rapid fashion for new and emergent LLM data rating, creation, and annotation needs.

• Analyze system metrics such as factuality, brevity, coherence, as well as subcomponent performance, summarize findings, and communicate results.

• This is not an annotator position, though annotation will occasionally be required to accommodate urgent requests.

Skills:

• Basic Python, basic SQL with strong desire to grow required for this position. Intermediate level preferred.

• Basic knowledge of linguistics (some of Phonetics, Syntax, Semantics, Dialectology) required.

• Ability to analyze numerical rating results and draw conclusions based on data.

• Basic stats / math for data analysis.

• Written and oral communication skills necessary for communicating on project milestones and for reporting findings .

Education/Experience:

• Bachelor’s degree in computational linguistics, speech science, or related field OR graduate degree in linguistics OR industry similar experience required.

• Master’s degree or beyond preferred OR equivalent industry experience.

• Additional learning via Coursera, Udemy, or other online resources great too.

Please submit a WORD resume to Jeanne, jsharpe@anzuglobal.com to be considered for this role or to request additional information.

We offer a referral bonus if you refer a colleague who is hired. Anzu Global is also actively seeking candidates with experience in Artificial Intelligence AI, Natural Language Processing NLP, Machine Learning ML, and Computational Linguistics.

Anzu Global

Latest Jobs

Linguistic Engineer – onsite