*project/opportunity details*:
a sweap task is a real-world github problem packaged with a testing environment and solution (i.e., the golden patch). This environment and solution are used to train an agent to solve the problem and verify the solution in the testing environment. A contributor's job is to verify the testing environment based on testing logs, categorize the problem by specificity and knowledge areas, and write additional notes to help an agent understand what a good solution looks like based on the code edited in "the golden patch" and notes on github.
*accepted locations*
*loom video*
our founder/ceo, gabe greenberg, created an in-depth loom video that we highly recommend you watch check it out here: loom video
*overview*
join our expert annotation team to create training data for the world's most advanced ai models. No previous ai experience is necessary. You'll get your foot in the door with one of the most prominent players in the ai/llm space today. We're seeking contributors with professional software engineering experience on production repositories and experience building and maintaining large-scale coding repositories. Projects typically include discrete, highly variable problems that involve engaging with these models as they learn to code. We currently have 200+ roles open
*what will i be doing?*
- verifying the testing environment based on testing logs.
- categorizing problems by specificity and knowledge areas.
- writing additional notes to help an agent understand what a good solution looks like based on the code edited in "the golden patch" and notes on github.
- evaluating the quality of ai-generated code, including human-readable summaries of your rationale.
- solving coding problems and writing functional and efficient code in various programming languages.
- writing robust test cases to confirm code works efficiently and effectively.
- creating instructions to help others and reviewing code before it goes into the model.
*pay rates*
compensation rates average at $30/hr and can go up to $50/hr. Expectations are 15+ hours per week; however, there is no upper limit. You can work as much as you want and will be paid weekly per hour of work done on the platform.
*contract length*
this is a long-term contract with no end date. We expect to have work for the next 2 years. You can end the contract at any time, but we hope you will commit to 12 months of work.
*flexible schedules*
*interview process*
- if you seem like a good fit, we'll send an async rlhf code review that will take 35 minutes and must be finished within 72 hours of us sending it.
- you'll receive credentials to the rlhf platform. We'll then set up a group call to answer any further questions about onboarding with the company.
- you'll perform a simulated production-level task (rlhf task) on the platform. This will be your final interview, which will ultimately determine your employment and leveling. Successful completion of this process provides you with an opportunity to work on projects as they become available.
*tech stack priorities*
the current priority for this team is contributors who are well versed in go, git, java, javascript, python, and typescript.
*required qualifications*
- professional software engineering experience on production repositories.
- experience building and maintaining large-scale coding repositories.
- complete fluency in the english language.
- ability to articulate complex technical concepts clearly and engagingly.
- excellent attention to detail and ability to maintain consistency in writing. Solid understanding of grammar, punctuation, and style guidelines.
*nice to haves*:
- bachelor's or master's degree in computer science.
- experience with modern javascript frameworks and libraries (next.js, vue, angular).
- familiarity with frontend testing frameworks (jest, react testing library, cypress).
- knowledge of state management solutions (redux, context api, mobx).
- experience with typescript and modern frontend tooling.
- recognized accomplishments or contributions to the coding community or in projects.
- proven analytical skills with an ability to approach problems creatively.
- adept communication skills, especially when understanding and discussing project requirements.
- a commitment to continuous learning and staying updated with the latest coding advancements and best practices.
- enthusiasm for teaching ai models and experience with technical writing
if you're passionate about software engineering and the future of ai technology, this is an excellent opportunity to contribute to cutting-edge ai technology while leveraging your expertise