Software Engineer - Scraping
Overview
Headquartered in Los Angeles, California, Right Balance provides top-tier technology talent for innovative companies in the US. We’re in the top 50 companies to watch in LA.
Engagement Details
Our client is a cutting-edge competitive intelligence platform designed for e-commerce brands to have real-time, actionable insight on their competition. The platform captures and analyzes data from hundreds of thousands of leading e-commerce sites, providing valuable insights about promotions, marketing calendars, terms, merchandising, site features, and UX best practices.
The Role Our client is seeking a highly skilled Software Engineer to join them as they revolutionize how eCommerce teams operate. The cutting-edge platform leverages AI, scraping technologies, and multi-cloud infrastructure to empower eCommerce brands with deep insights into competitor strategies, marketing calendars, merchandising, product detail page performance and much more. This role requires strong experience in scraping, TypeScript, AI technologies, and multi-cloud solutions (AWS and GCP). You'll play a key role in architecting, developing, and scaling our systems and internal tools, driving innovation across our entire technology stack. You'll join a dynamic, passionate team that's transforming how eCommerce businesses gain insights and drive growth. We view our technology as a teammate, fostering an environment of ingenuity, transparency, and continuous learning. Tech Stack: TypeScript, Next.js, React, Vercel AWS (Lambda, SQS, SES, S3, CDK, Bedrock), GCP (BigQuery, Cloud Functions) Supabase, Inngest, Qdrant, LocalStack Stripe integration for subscription management
Location : Fully remote - at least 6 hours overlap with either PST or EST.
Length: 6-month engagement, potentially extended.
Key Responsibilities
- Architect and develop scalable full-stack solutions powering our competitive intelligence platform, from customer-facing applications to internal analytics tools
- Building and maintaining website scraping at scale; expertise in writing scrapers, using proxies, and building all the infrastructure.
- Design, build, and optimize AI-driven features utilizing advanced LLMs and multi-modal models
- Implement robust scraping solutions and automated workflows (Inngest, AWS Lambda, etc.) to capture and analyze data from thousands of eCommerce sites
- Work extensively with cloud infrastructure across AWS and GCP, managing services such as Supabase, BigQuery, Lambda, and LocalStack
- Develop and optimize efficient databases, leveraging Supabase and vector databases (Qdrant)
- Collaborate closely with product and data teams to translate complex business requirements into elegant, high-performing solutions
- Mentor junior engineers, lead code reviews, and promote engineering best practices
- Continuously improve development workflows, DevOps pipelines, and automation practices
- Contribute actively to technical documentation and architecture diagrams
What’s in it for you
- Learn and evolve your skills using the latest and greatest technology tools in a rapidly growing company.
- Learn from the best people around you. We constantly challenge the status quo and invent new ways of building a great product.
- 100% remote. Work anywhere, whether it is remotely in the comfort of your home, in a shared co-working space, in an RV on the beach, or while being a nomad in another country.
- Work on challenging problems, innovate, and positively impact many people's lives while having fun doing it.
Required Qualifications
- Upper-intermediate to fluent speaking and writing English. Able to have a real-time conversation.
- 6+ years of full-time hands-on in Fullstack Software Development experience.
- 4+ years of full-time hands-on Scraping experience.
- 4+ years of full-time hands-on Node.js API experience.
- 3+ years of full-time hands-on React experience.
- 2+ years of full-time hands-on AWS experience.
- Expert proficiency in TypeScript and modern JavaScript frameworks (Next.js, React)
- Demonstrable experience in AI/ML development, particularly with LLMs, OpenAI, or similar models
- Strong cloud infrastructure skills in AWS and GCP, familiarity with multi-cloud architectures
- Proven experience with services like Supabase, BigQuery, and modern database technologies
- Familiarity with event-driven architectures and tools like Inngest
- Comfortable working in CI/CD environments and automated deployment processes
- Excellent problem-solving abilities, attention to detail, and a drive for high-quality results
- Strong communication skills, collaborative mindset, and experience working with cross-functional teams
- Python experience for scripting and backend data processing is preferred
- Experience with eCommerce analytics or competitive intelligence is a significant advantage
- Startup experience and adaptability in a high-growth, fast-paced environment preferred
Nice to haves
- 1+ years of full-time hands-on AI Development experience.
- Bachelor’s degree in Computer Science or equivalent demonstrated ability.
Frequently Asked Questions
What are your typical clients?
The majority of our clients are venture-backed startups at the growth stage. Usually, at this stage, the company already achieved a product-market fit and is looking to expand rapidly. That’s where we bring the best engineering practices, strong architecture, the latest technologies, and consistent processes to help companies scale.
What is the length of your engagements?
Most of our long-term full-time engagements last multiple years. It allows you to evolve your career with the client company taking on more responsibilities.
What’s your company size?
The Right Balance team is 55+ engineers going to 5+ by the end of the year. The current client size team is 43+ people. The timing is great to be a part of a rapidly growing team making meaningful contributions.
What happens if the engagement is completed?
Most of our engagements are long-term in nature. That said, if the current engagement is ramping down, we’ll present you with more long-term opportunities to transition into.
What are your core values?
Client First: we only win when our clients win. We treat client challenges as our own.
Ownership: we embrace responsibility, taking on challenges, getting them to completion, and enjoying getting things done.
Quality: we’re passionate about achieving quality outcomes by applying meticulous attention to detail.