Software Mind

[RNS] Data Engineer

Nov 18, 2023

Kraków, Poland

Company Description

Software Mind develops solutions that make an impact for companies around the globe. Tech giants & unicorns, transformative projects, emerging technologies and limitless opportunities – these are a few words that describe an average day for us. Building cross-functional engineering teams that take ownership and crave more means we’re always on the lookout for talented people who bring passion and creativity to every project. Our culture embraces openness, acts with respect, shows grit & guts and combines employment with enjoyment.

Job Description

Project – the aim you’ll have

Our partner is a new fully funded venture as part of a wider international consulting organisation.

While working on this greenfield project you will help design and implement a game-changing SaaS platform from scratch, helping global manufacturers by breaking down their products to understand how best to optimize costs, cut carbon emissions, and build sustainably.

Position – how you’ll contribute

Prototyping, designing and implementing new functionalities;

  • Graph Database Development: Designing and implementing effective graph data models in Cosmos DB using Gremlin. Developing and optimizing Gremlin queries for data retrieval and manipulation.
  • Data Integration and Pipeline Management: Building and managing ETL pipelines for data ingestion into Cosmos DB. Ensuring seamless integration of data from various sources, while maintaining data quality and integrity.
  • Performance Tuning: Monitoring and optimizing the performance of Cosmos DB instances. Implementing strategies to ensure efficient data storage, quick query responses and overall system reliability.
  • Data Analysis and Reporting: Utilizing graph database structures to perform complex data analysis. Developing reports and insights based on graph data.
  • Collaboration with Cross-Functional Teams: Working closely with data scientists, analysts and other engineering teams to understand data needs and implement appropriate graph database solutions.

Best Practices and Documentation: Establishing best practices for graph database management, with a focus on cost optimization. Documenting database designs, configurations and procedures for effective knowledge sharing.

  • Staying Up to Date with Technologies: Staying informed on the latest trends and advancements in graph databases, particularly related to Azure Cosmos DB and Gremlin API.

Qualifications

Expectations – the experience you need

  • Ability to write and speak English at a B2+ level.
  • Experience: Minimum 3 years’ experience in data engineering, with specific expertise in graph databases and Azure Cosmos DB.
  • Technical Skills:
    • Proficiency in designing and managing graph databases, using Azure Cosmos DB and Gremlin API in particular.
    • Strong experience in building and maintaining ETL pipelines.
    • Familiarity with Azure cloud services and ecosystem.
    • Proficiency in query languages like SQL, Gremlin.
  • Analytical Skills: Ability to analyze complex datasets and develop efficient data models and queries.
  • Communication Skills: Excellent communication skills to collaborate with various teams and stakeholders.
  • Problem-Solving Skills: Strong problem-solving abilities and a methodical approach to addressing challenges in a dynamic environment.

Additional skills – the edge you have

  • Certifications in Azure or relevant technologies.
  • Experience with other graph database technologies.
  • Familiarity with big data tools and platforms, as well as knowledge of data security and compliance standards.

Additional Information

Our offer – professional development, personal growth 

  • Flexible employment and remote work  
  • International projects with leading global clients 
  • International business trips  
  • Non-corporate atmosphere 
  • Language classes 
  • Internal & external training 
  • Private healthcare and insurance  
  • Multisport card 
  • Well-being initiatives

 

Position at: Software Mind Poland

Join 27662+ Machine Learning Engineers, receiving daily job alerts.