Staff Data Engineer, Analytics Architecture

April 21, 2022

Remote, USA

At ASAPP, our mission is to solve complex and challenging problems by building transformative machine learning-powered products. We leverage artificial intelligence to address significant challenges that share three common characteristics: huge economic scale, systemic inefficiencies, and tremendous amounts of data. Our talented teams that drive our product innovation and development are located in New York City, Mountain View, Buenos Aires, and remote locations around the United States. The data engineering team at ASAPP powers the core of our data and analytics products. ASAPP's products are based on natural language processing and serve tens of millions of end-users in real time. We need sophisticated metrics to monitor and continuously improve our systems.  We are seeking a Staff Data Engineer to serve as both a technical leader and the core contributor by designing and building analytic data feeds for both our business partners and internal stakeholders. What You'll Do Lead the team by providing the groundwork to redesign our analytics architectureDesign a data warehouse to facilitate analysis across hundreds of systems eventsReview code for style and correctness across the entire teamWrite production-grade Redshift & Athena SQL queriesManage and maintain Airflow ETL jobsTest query logic against sample scenariosWork across teams to gather requirements and understand reporting needsInvestigate metric discrepancies and data anomaliesDebug and optimize queries for other business unitsReview schema changes across various engineering teamsMaintain high-quality documentation for our metrics and data feeds Contribute to our data infrastructure platform and toolingParticipate in our on-call rotation to keep production pipelines up and running What You'll Need Expertise in at least one flavor of SQL. We use Amazon Redshift and MySQL.Proficiency in a high-level programming language, especially in terms of reading and comprehending other developers’ code and intentions. We use Python, Scala, and Go.Experience building data warehouses on AWS using Redshift, Athena, or EMR.Deep technical knowledge of data exchange and serialization formats such as Protobuf, YAML, JSON, and XML.Familiarity with workflow management systems such as Apache Airflow or dbtASAPP is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, disability, age, or veteran status. If you have a disability and need assistance with our employment application process, please email us at to obtain assistance. Please note this role is open to candidates outside of Colorado as well. The information below is provided for those hired in Colorado only.If you are a Colorado applicant:- The estimated pay range for this role, based in Colorado, is $160,000 - 180,000.- For Sales positions: this role is eligible to earn commissions and eligible to participate in ASAPP's equity plan.- For Non-Sales positions: this role is eligible to participate in ASAPP's equity plan.The actual salary may be different depending upon non-discriminatory factors such as qualifications, experience, and other factors permitted by law. The range listed is just one component of ASAPP’s total compensation package; other rewards may include short- and long-term incentives, including the benefits listed above. #LI-AG1 #LI-Remote

Built with ❤️ for the ML Community by Dom © 2022 RemoteML