The Company
My client, a global leader in shipping and logistics, is embarking on a transformative journey towards digital innovation and sustainable growth. As part of this initiative, they are forming a dynamic Development and Data Team to shape the future through data-driven strategies. They are currently seeking a dedicated Data Engineer to lead Data Warehouse initiatives. If you're a passionate data engineering professional eager to drive business transformation, explore this unique opportunity.
Key Roles & Responsibilities
- Develop, test, and deploy enterprise-level applications using Snowflake technology
- Conceptualize and implement features to enhance identity and access management
- Establish robust authorization frameworks to ensure enhanced access control
- Implement innovative query optimization techniques and robust security measures, including encryption
- Address and resolve performance and scalability challenges within the system
- Execute transaction management through advanced distributed data processing algorithms
- Construct, oversee, and optimize ETL and ELT processes, incorporating efficient data models
- Incorporate the latest data architecture delivery approaches into the implementation
- Create comprehensive project documentation aligned with user requirements
- Manage and maintain documentation related to data models, architecture, and maintenance procedures
- Regularly review and enhance data models through rigorous auditing
- Ensure the seamless maintenance of an efficient data pipeline based on ETL tools
- Collaborate closely with Business Intelligence experts and analysts to integrate customized data models
- Perform code updates, develop new code, and engage in reverse engineering as needed
- Conduct performance tuning, user acceptance training, and application support
- Conduct thorough risk assessments, develop mitigation plans, and manage risks effectively
- Engage regularly with cross-functional teams for status reporting and routine activities
- Lead migration efforts between databases or from on-premises to cloud environments
Requirements
- Experience in designing and developing enterprise-level Snowflake applications.
- Proficient in data ingestion processes for Snowflake.
- Demonstrated expertise in Snowflake modeling, encompassing roles, databases, and schemas.
- Skilled in performance optimization techniques and the implementation of resource monitoring strategies.
- Proficient in measuring SQL performance, query optimization, and database tuning.
- Proficient in utilizing ETL tools to construct robust data warehouses.
- Competent in managing and integrating sets of XML, JSON, and CSV data from diverse sources.
- Extensive knowledge in:
o Snowflake warehousing, architecture, processing, and administration.
o SQL language and cloud-based technologies, including data warehousing concepts, data modeling, and metadata management.
o SQL-based databases such as Oracle SQL Server, Teradata, etc.
o Coding proficiency in languages like Python, Java, and JavaScript.
o Adept in conducting root cause analysis of models and proposing effective solutions.