*project/opportunity details*:
a sweap task is a real-world github problem packaged with a testing environment and solution (i.e., the golden patch).
this environment and solution are used to train an agent to solve the problem and verify the solution in the testing environment.
a contributor's job is to verify the testing environment based on testing logs, categorize the problem by specificity and knowledge areas, and write additional notes to help an agent understand what a good solution looks like based on the code edited in "the golden patch" and notes on github.
*accepted locations*
*loom video*
we have created an loom video that we highly recommend you watch!
check it out here: loom video
*overview*
join our expert annotation team to create training data for the world's most advanced ai models.
no previous ai experience is necessary.
you'll get your foot in the door with one of the most prominent players in the ai/llm space today.
we're seeking contributors with professional software engineering experience on production repositories and experience building and maintaining large-scale coding repositories.
projects typically include discrete, highly variable problems that involve engaging with these models as they learn to code.
we currently have 200+ roles open!
*what will i be doing?
*
- verifying the testing environment based on testing logs.
- categorizing problems by specificity and knowledge areas.
- writing additional notes to help an agent understand what a good solution looks like based on the code edited in "the golden patch" and notes on github.
- evaluating the quality of ai-generated code, including human-readable summaries of your rationale.
- solving coding problems and writing functional and efficient code in various programming languages.
- writing robust test cases to confirm code works efficiently and effectively.
- creating instructions to help others and reviewing code before it goes into the model.
*pay rates*
compensation rates average at $30/hr and can go up to $50+/hr.
expectations are 15+ hours per week; however, there is no upper limit.
you can work as much as you want and will be paid weekly per hour of work done on the platform.
*contract length*
this is a long-term contract with no end date.
we expect to have work for the next 2 years.
you can end the contract at any time, but we hope you will commit to 12 months of work.
*flexible schedules*
*interview process*
- if you seem like a good fit, we'll send an async rlhf code review that will take 35 minutes and must be finished within 72 hours of us sending it.
- you'll receive credentials to the rlhf platform.
we're doing regular calls to answer any further questions about onboarding, as well as providing a support team at your disposal.
- you'll perform a simulated production-level task (rlhf task) on the platform.
this will be the final stage, which will ultimately determine your leveling and which project you'll be assigned.
successful completion of this process provides you with an opportunity to work on projects as they become available.
*application requirements*
- valid identification document from your current country of residence is required
- linkedin profile with 5+ connections is mandatory
*tech stack priorities*
- go: concurrency management, race conditions, web server implementations
- java: thread-safe implementations, caching systems, concurrent operations
- typescript: advanced type features, generics, utility types
- javascript: deep object cloning, memory management, prototypal inheritance
- python: optimization techniques, algorithm implementation, recursion
*required qualifications*
- professional software engineering experience on production repositories.
- experience building and maintaining large-scale coding repositories.
- complete fluency in the english language.
- ability to articulate complex technical concepts clearly and engagingly.
- excellent attention to detail and ability to maintain consistency in writing.
solid understanding of grammar, punctuation, and style guidelines.
*nice to haves*:
- bachelor's or master's degree in computer science.
- experience with modern javascript frameworks and libraries (next.js, vue, angular).
- familiarity with frontend testing frameworks (jest, react testing library, cypress).
- knowledge of state management solutions (redux, context api, mobx).
- experience with typescript and modern frontend tooling.
- recognized accomplishments or contributions to the coding community or in projects.
- proven analytical skills with an ability to approach problems creatively.
- adept communication skills, especially when understanding and discussing project requirements.
- a commitment to continuous learning and staying updated with the latest coding advancements and best practices.
- enthusiasm for teaching ai models and experience with technical writing!
if you're passionate about software engineering and the future of ai techn