SparkCognition

Data Engineer II

June 2, 2022

Anywhere

Voted Best Places to Work in Austin, Best Paying Companies, and Top Startup Companies by Forbes SparkCognition looks to bring in the best talent in the world. To accommodate the hiring of our wildly talented teams, SparkCognition sponsors visa opportunities when appropriate. Who are we and why this opportunity? Drive change and create a footprint. SparkCognition invests in our employees and fosters collaboration throughout the organization. Our employees have the ability to work globally with award-winning artificial intelligence (AI) technology within multiple industries. What are the benefits and perks at SparkCognition?  You and your loved ones will be supported with a competitive and comprehensive benefits package. Below are some highlights - we’d love to connect and share more!  Fast-paced evolving culture with the opportunity to drive new ideas and technology. Dynamic Work Environment - Remote and In-Office Options   Stock Option Grants Generous Time Off Programs Medical Coverage, and Parental Leave Plans  401k with Employer Match Monthly Technology Allowance  Large 2022 renovated office space centrally located near the Arboretum in Austin, TX- including fully stocked beverage and snack areas! Data Engineer II SparkCognition catalyzes sustainable growth for our clients throughout the world with proven artificial intelligence (AI) systems, award-winning machine learning technology, and a multinational team of AI thought leaders. Our clients are trusted with advancing lives, infrastructure, sustainability, and financial systems across the globe. They partner with SparkCognition to understand their industry’s most pressing challenges, analyze complex data, empower decision-making, and transform human and industrial productivity with scalable AI solutions to solve the problems that matter most. SparkCognition’s Ensemble platform is world’s first AI enabled SaaS platform provides prescriptive analytics to power plant operators by combining the power of machine learning, big data, and deep domain expertise. As a senior data engineer, you will be participating in developing and deploying fault-tolerant ETL pipelines, perform data visualization and enable development of ML algorithms.   Join us in: Designing and implementing platform services, frameworks, and data workflows for data scientists and ML Engineers Driving efficiency and reliability improvements through design and automation: performance, scaling, observability, and monitoring Assembling large, complex data sets that meet functional/non-functional business requirements Identifying, recommending, and implementing ETL/ELT, application integrations, event pipelines and general architecture improvements Developing disaster recovery and failover strategies for the data integration environment Identifying limitations and required features in the Data Platform with peer teams to design and implement them Driving performance enhancements, development best practices and collaborate with other Data Engineering team members   You’ll have: 3+ years of experience in data engineering & strong understanding of data engineering principles using big data technologies Excellent programming skills in Python is mandatory Expertise in relational databases (MSSQL/MySQL/Postgres) and experience in ElasticSearch Exposure to deploying ETL pipelines such as AirFlow, Docker containers & Lambda functions Experience in AWS loud services such as AWS CLI, Glue, Kinesis etc Hands on experience on Cloud Computing such as Amazon Web Services, Azure, GCP A strong work ethic, along with the ability to prioritize and complete all job responsibilities in a timely manner Ability to be responsive with a willingness to take ownership of issues and drive solutions. Excellent communication skills Excellent time management and organizational skills   SparkCognition is an equal opportunity employer, dedicated to diversity, equality, and inclusion, and provides equal employment opportunities to all employees and applicants for employment.  SparkCognition prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.Explore SparkCognition:  https://www.sparkcognition.com/company/  BuiltIn Austin  SparkCognition is an equal opportunity employer, dedicated to diversity, equality, and inclusion, and provides equal employment opportunities to all employees and applicants for employment.  SparkCognition prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. #remote #ai #bethespark

Built with ❤️ for the ML Community by Dom © 2022 RemoteML