Log In
Sign Up
Applications have closed
About the company:
Avenue Code is the leading software consultancy focused on delivering end-to-end development solutions for digital transformation across every vertical. We’re privately held, profitable, and have been on a solid growth trajectory since day one. We care deeply about our clients, our partners, and our people. We prefer the word ‘partner’ over ‘vendor’, and our investment in professional relationships is a reflection of that philosophy. We pride ourselves on our technical acumen, our collaborative problem-solving ability, and the warm professionalism of our teams.
Avenue Code has been believing in and promoting plurality actions for over 10 years, understanding that recognizing differences and fostering a safe environment, employment opportunities, representation, and support are the best ways to promote an increasingly equitable culture.
About the opportunity:
We are seeking a highly experienced Data Engineer with exposure to lead or help other data engineers. The ideal candidate will possess a deep knowledge of Python, Java, Kafka, Spark, Flink, Elasticsearch, and graph data technologies. This role requires strong debugging and systems knowledge to ensure high availability and performance of our data systems and to efficiently address production issues. This is a hybrid position 2 days a week in San Francisco/San José – CA. There will be on-call rotations to address high-priority production issues and maintain system uptime.
Responsibilities:
• Help other data engineers in designing, building, and maintaining advanced data pipelines and architectures.
• Act as a subject matter expert in production system operations, including monitoring, debugging, and resolving production issues efficiently.
• Implement real-time and batch data processing solutions using Kafka, Spark, Flink, and other relevant technologies.
• Leverage Elasticsearch to enhance search and analytics capabilities, ensuring optimal performance and scalability.
• Utilize graph and vector databases and fine-tune language models (LLMs) to support innovative data applications.
• Collaborate with global engineering teams, particularly in the India Time Zone, to manage cross-functional projects and initiatives.
• Provide technical guidance and mentorship, fostering a culture of continuous improvement and learning within the team.
• Develop and enforce best practices for data quality, reliability, and systems security.
• Participate in on-call rotations to address high-priority production issues and maintain system uptime.
Required Qualifications:
• Strong experience in data engineering.
• Expert proficiency in programming languages such as Python or Java, with a strong background in data processing and analytics.
• Deep understanding of Kafka, Spark, Flink, and Elasticsearch, with hands-on experience in production environments.
• Experience with graph databases, graph algorithms, and NLP techniques, including LLM fine-tuning.
• Strong debugging skills and experience with production system operations, including performance tuning and troubleshooting.
• Excellent communication and collaboration skills, with the ability to work effectively across time zones and cultures.
Nice to Have:
• Hybrid – 2 days a week in San Francisco or San Jose, CA. Avenue Code discloses salary range information in compliance with state and local pay transparency obligations. It considers a wide range of factors such as internal equity, geographic location, relevant education, qualifications, certifications, experience, skills, seniority, business or organizational needs and others. At Avenue Code it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range for US Based Data Engineer is $90.000 USD to $110.000 USD per year.
Avenue Code reinforces its commitment to privacy and to all the principles guaranteed by the most accurate global data protection laws, such as GDPR, LGPD, CCPA and CPRA. The Candidate data shared with Avenue Code will be kept confidential and will not be transmitted to disinterested third parties, nor will it be used for purposes other than the application for open positions. As a Consultancy company, Avenue Code may share your information with its clients and other Companies from the CompassUol Group to which Avenue Code’s consultants are allocated to perform its services.
