We are seeking a skilled Python Developer to join our team and contribute to the evaluation of AI-driven solutions. The successful candidate will be responsible for assessing the step-by-step solutions generated by an AI assistant, ensuring the accuracy, efficiency, and correctness of its problem-solving processes.
More about the role:
- We're looking for Python developers
- 3-5 years of experience ideally
- English language level from C1 (Advanced) and above
- Rate $20-30 per hour gross
- We need several freelancers to help complete 800 tasks (45 minutes each) by the end of August 2024.
- We are not able to hire from the following countries: Iran, Cuba, North Korea, Syria, Sudan, Venezuela, Myanmar, Switzerland, Armenia, Belarus, Israel, Kazakhstan, UAE, Netherlands, Russia, Serbia, Kyrgyzstan, Turkey, Uzbekistan
Key Responsibilities:
- Evaluate AI-generated Solutions:
- Analyze and evaluate the AI assistant step-by-step solution trajectories.
- Assess each action and thought of the Agent using a ternary format (positive, neutral, negative).
- Determine if each step taken by the Agent brings it closer to solving the problem, provides a neutral impact, or contains obvious errors.
- Provide Constructive Feedback:
- Offer detailed comments on negative actions, clearly explaining the mistakes.
- Provide comments on positive actions that add significant value to the solution.
- Collaborate with Development Team:
- Work closely with the development and AI teams to report findings and suggest improvements based on evaluations.
- Contribute to improving the evaluation process and methodology.
Requirements:
- Strong proficiency in Python programming.
- English language level from C1 (Advanced) and above
- Strong analytical and problem-solving skills.
- Ability to clearly and concisely document evaluations and provide feedback.
- Collaborative mindset, with the ability to work effectively within a team.
Interested?? Click me to apply
Medium Level
Type Fixed
Duration: More than 06 months