Python GenAI Model Evaluator Job at ClifyX, Austin, TX

UGVEZ1JLYTFzZVkzMW4rMjRzUHV4UWFxMHc9PQ==
  • ClifyX
  • Austin, TX

Job Description

Please share 2 onsite profiles for Model Evaluators . Location can be either SCV or Austin. Billing : $78/Hr Technical Skills

  • Strong understanding of LLMs, generative AI, and transformer-based architectures.
  • Experience with Python, data analysis, and model evaluation frameworks.
  • Familiarity with prompt engineering, embeddings, RLHF/RLAIF, and LLM-based scoring methods.
  • Experience building evaluation datasets and working with annotation platforms.
  • Understanding of safety alignment, bias detection, and adversarial testing.
Tools & Platforms
  • ML/AI frameworks: PyTorch, TensorFlow, HuggingFace, LangChain.
  • Evaluation/annotation tools: Scale AI, GroundTruth, Labelbox, Prodigy.
  • Prompt testing tools: Weights & Biases, MLflow, OpenAI evals, LLM-as-a-judge pipelines.

Job Tags

Similar Jobs

The Kerryman Bar & Restaurant

Busser Job at The Kerryman Bar & Restaurant

The Kerryman Bar & Restaurant is an award winning establishment that has been open in River North for over 20 years. We are now hiring for a part time busser. Candidate must be able to work nights and weekends. The successful candidate should be prepared to work as...