About the job:
As a Data Engineer, you know the importance of data to business. You design and set up projects that bring together information from a variety of sources, to enable analysis and decision-making. You make sure that data is accessible and easy to use, so that it can be used for routine and ad-hoc analysis.
Day-to-day you:
- Use your knowledge to plan and deliver data warehouses and storage
- Take part in crafting and running bespoke data services for individual projects
- Stay up to date with business best practice in using and retrieving data
- Design, develop, adapt, and maintain data warehouse architecture and relational databases that support data mining
- Customize storage and extraction, metadata, and information repositories
- Build and use effective metrics and monitoring processes
- Help to develop business intelligence tools
- Craft and maintain report forms and formats, information dashboards, data generators and canned reports, as well as other information portals and resources
Your skills:
You have got a great experience in data and analysis, and how to source, store and share information. You’re a problem solver who’s happy to work autonomously and to share their knowledge and skills, as well as guiding other team members.
Your skills and experience include:
- Strong knowledge of Python, Spark, and T-SQL
- Database, storage, collection and aggregation models, techniques, and technologies - and how to apply them in business
- Experience in structured problem solving
- Strong knowledge of Python, Spark, and T-SQL
- Superb communication skills
- Ability to use technology to aim business problems using one or more Microsoft Analytics services for building data pipelines, data streams, and system integration
Desirable skills:
- Knowledge of Azure tools such as Azure Data Factory, Azure Data Lake, Azure SQL DW or Azure SQL
- Knowledge of Big Data tools such as Hadoop / Azure HDInsight + Spark, Azure Cosmos DB, Azure Databricks, Azure Stream Analytics
- Experience preparing data for Data Science and Machine Learning
- Crafting and building Data Pipelines using streams of IoT data
- Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code fundamentals
- You’re likely to have a Bachelor’s degree in IT, Applied Mathematics, Statistics or another meaningful field, or an equivalent combination of education and experience. You also have several years of relevant professional experience.
"We're collaborating with a top grocery retailer to establish a Data and AI Center of Excellence (CoE). Dive deep into varied business challenges, collaborating closely with different departments. We're seeking skilled data engineers and scientists to craft functional applications and innovative data visualization tools. Join us in making data-driven transformations that impact both the organization and its customers. Your expertise will be pivotal in shaping real-world solutions."
[1] Youtube Video
References
Visible links
1. https://youtu.be/SEE9wePPDOQ
