Senior Data Engineer

September 08

Job description

The project is about creating two microservices:
Stock Position
Stock Mutation for physical grocery stores in the Netherlands.
Stocks are the heart of a store and currently they are in an Oracle monolith.
The stock information of the stores will be consumed by IT sub systems like Data Lake, Finance, Store Operations, Sustainability, Replenishment systems, End Consumer Mobile applications.
The project has to ensure that this information is available in a performant way via API’s and will act as a golden source.

Data Engineering: Pyspark, Python, Azure SQL, Azure Synapse, Azure Data Factory, Azure Data Lake, Spark SQL, Databricks
Platform Engineering: Azure Devops, Terraform, Databrics, AWX Ansible, Kafka, Mule
Infrastructure: Azure, Terraform, Kubernetes (AKS), Helm, Docker

Health Insurance - Medicover (partially refunded by the employer)
Multisport card (partially refunded by the employer)
Development inside Stepwise:
Coaching Day - internal soft skills workshops / training for all employees once a month. Additionally, the possibility of arranging individual Coaching sessions
Tech Tuesday - weekly meetings during which topics related to technologies in which we work or our projects case studies are presented
Internal trainings
Freedom to Choose or Speak up - the possibility of real influence on the choice of work tools, technology, work methodology or rules of cooperation with the client
Opportunity to participate in industry conferences
English language classes - free individual online classes with Native Speaker
Free fruit and juices for employees
Shared lunches - Trip Around the world
On Tuesdays and Thursdays we meet for lunches at Stepwise's expense.
A new restaurant recommended by employees every week
Employee Recommendation Program - the employee receives PLN 10,000 net for employing each recommended candidate
Company library - Employees can use the books that are available on Stepwise for personal development. We are also open to suggestions to purchase additional items
Corporate integration - team building outings and weekly virtual integration to get to know each other better (mini-golf, cooking workshops, escape room and even more!)
Casual Dress-Code

Responsibilities

Building quality software and infrastructure (Azure based Data Platform)
Development of data models and processing of raw data at scale to make it available for analysis
Desiging, building and maintaining data pipelines to ensure highly accurate and reliable solutions for analytical needs
Analyze and improve efficiency, scalability, and stability of applications
Identify unnecessary complexity and remove it
Understanding business context and translate stakeholder needs into well-designed data models
Work cross-functionally with analysts and various engineering and data science teams to identify and execute new opportunities
Create structured and reliable documentation;

Requirements and qualifications

5+ years of experience designing and implementing data platform solutions that processed, transformed data efficiently, secure and reliable.
Strong programming skills in Python.
Strong hands-on Azure data technologies experience such as ADLS, Databricks, EventHub, Synapse, SQLServer, DevOps, Terraform, Python, PySpark Bash, Git.
Agile and DevOps mindset and experience in architect role in such environment
A deep understanding of software development
Solution oriented and result driven
Excellent verbal and written communication skills , able to communicate with business and translate requirements into concrete user stories, work with a team to refine and realize stories.
Strong ability to design, document, present, communicate and implement a solution.
Strong interpersonal skills and ability to deal with complexity of large organizations
Good knowledge of English (min. B2 level)

Increase your chances of getting this job

Prove your
skills online

Show your talent in Skill Verification Challenges

Apply with CV+
Verified Skill Profile

You decide which skills you want to reveal

Recruiter see
your verified skills

Not just resume. It makes you stand out against other candidates

Invitation to
final interview

Faster. Based on skills you demonstrate not just declare on CV

Job description