Job Description

SENIOR DATA ENGINEER

Brief Description

The position of Senior Data Engineer at Celestial Systems is responsible for designing and maintaining data architectures, ensuring data accessibility and reliability. As a Senior Data Engineer, optimize data pipelines, transforming raw data into actionable insights and predictive algorithm models to support well-informed decision-making and drive business intelligence. Through visual representations, they communicate complex data insights, fostering a culture of data-driven innovation.

Terms of employment: Permanent, Full-time, Long-term

Wages: $60.00 per hour

Hours of work: 32 hours per week

Tasks

Design and develop data architectures and models to capture the data from various sources and support the business intelligence, analytics, and reporting requirements.
Supervise research and analysis initiatives, integrating structured and unstructured data, and utilizing programming techniques for data cleaning and organization.
Allocate tasks and responsibilities to team members, ensuring a balanced workload and effective management of project priorities.
Applying statistical and mathematical methodologies to analyze data, identify trends and anomalies, draw meaningful conclusions to solve different business problems.
Create and execute automation tools for data pipeline orchestration, with hands-on expertise in ADF, Data Bricks, and SQL programming.
Track the performance and progress of the data engineering team, providing constructive feedback and support to foster ongoing improvement.
Conduct extensive experiments on a large scale to unveil intricate connections between variables within extensive datasets.
Implement predictive models and algorithms for various applications to meet the business needs of organizations, such as forecasting and risk assessment.
Creating data visuals to prompt quick decision-making and empower business teams with actionable insights.
Mentor junior data engineers by offering advice on best practices, conducting code reviews, and addressing technical challenges.
Creating sophisticated methods to construct predictive models, incorporating regression, clustering, decision trees, scenario analysis
Proficiency in programming languages such as Python or R to manipulate and analyze data efficiently.
Implement data security measures to protect sensitive information and ensure compliance with data privacy regulations.
Organize and conduct training sessions or workshops to enhance the team's technical skills and knowledge.
Working closely with cross-functional teams and domain experts to understand business problems and develop data-driven solutions.

Qualifications and Requirements

Bachelor's degree in computer science, mathematics, data engineering, or a related field. Advanced degree is a plus.
Five years of proven experience as a Data Engineer or in a similar role, with a strong portfolio showcasing your data engineering projects.
Strong problem-solving and analytical skills to effectively debug and resolve data issues.
Solid understanding of modeling development principles, algorithms, and data structures.
Excellent communication and collaboration skills to work effectively in cross-functional teams.
Ability to manage multiple tasks and projects concurrently while meeting deadlines.
Experience with version control systems (e.g., Git) and agile development methodologies is a plus.

Competencies (in order of importance)

Data Processing - Expertise in data processing tools like ADF & Data Bricks. Capable of data cleansing, transformation, and enrichment. Proficient in data pipeline design and optimization. Ability to design and maintain data architecture and infrastructure.
Data Modeling – Experience in designing data models and schemas. Understanding of structured and un-structured datasets.
Programming Skills - Strong programming skills in languages such as Python/Scala. Ability to develop custom scripts and tools for data processing and automation.
Problem Solving – Identify and resolve software issues and challenges to deliver high-quality solutions.
Collaboration – Effectively collaborating with cross-functional teams to achieve software development goals.
Analytical Thinking – Analyzing complex problems and applying logical thinking to develop effective software solutions.
Communication – Effective communication skills to articulate technical concepts and collaborate with stakeholders.
Adaptability – Adapting to evolving technologies, industry trends based on product/project requirements.

Lines of Communication

The Data Engineer reports to the VP Business Development or Accounts Manager and collaborates closely with cross-functional teams, including product managers, designers, and quality assurance engineers.

Working Conditions

This is a permanent, full-time and indeterminate position. The Senior Data Engineer will work in an office environment with the necessary software development tools and equipment. Occasional overtime may be required to meet project deadlines or address critical project issues.

Preference given to applicants who are Canadian citizens, Canadian Permanent Residents, Asylum Seekers with valid open work permit, New Immigrants, Indigenous Persons / Aboriginals, Visible Minorities, Vulnerable Youth, Persons with Disabilities etc. If interested in this position, please apply by email at hr@celestialsys.com or by mail to 201-4279 Dawson Street Burnaby, BC V5C 4B3 with a resume and cover letter.

We thank all applicants for their interest in the position; however, only those selected for interviews will be contacted.