Senior Data Engineer – Toronto or Remote

From breaches to hacks, the world of data privacy is always an eventful one. Seriously. There is always something going on. We are right at the forefront when it comes to innovation and data privacy, and are always looking for hard-working, barrier breakers to join our team! Are you looking to pivot to the data privacy landscape? Do you want to work in a fast-paced environment with a team that is eager to hear from you?

We are looking to add a highly motivated and results-oriented Senior Data Engineer to join our engineering team.

Who you are:

  • You have a passion for distributed computing, large data platforms, and event-based data
  • You are not fazed by complex, unstructured problems dealing with disparate data sets
  • You have a passion for privacy, consented data, and personal data control
  • You have a flair for optimization of systems running at scale
  • You want to do more than create a data pipeline or reports; you want to unique data sets and insights never seen before
  • You know how to find data, move it around, transform and fill in the gaps and implement your ideas through programming/statistical languages
  • You are the person who volunteers for new challenges, even in the face of uncertainty and not always being the expert

What you will be responsible for:

  • Designing and developing Killi’s Data Platform which represents the first real-time, consented, multi-compliant data ingestion, analysis, and insights platform in the world
  • Helping build the vision, strategy for the future state of the global data market
  • Understanding and embracing the disparate nature of consented and public data
  • Scaling existing architectures while designing, adapting, and evolving for new data sets and challenges
  • Processing, cleansing, and verifying the integrity of the data used for analysis and for sales

What we need from you:

  • An undergraduate degree in Computer Science/Engineering or equivalent from an accredited university
  • 3+ years in Software Development in challenging environments
  • Experience with Kafka/Pulsar, CDC, or other event-based processing platforms.
  • Experience with Spark, Hadoop, or other distributed processing technologies.
  • Experience with RedShift, EDW, and large cloud-based data storage facilities
  • Experience in Python and Java/Scala
  • Experience with various AWS technologies and platforms
  • An understanding of how to build scalable systems that can handle terabytes of data each day and at the same time handle millions of events in real-time

What we would like to see as a bonus:

  • Experience in scaling event-driven pipelines like Kafka, Kafka Connect, and CDC
  • Experience with GraphDBs like AWS Neptune (preferred) or neo4j
  • Experience with AWS Lambda, API GW, EC2, EKS, Step-Functions, RedShift, RDS, S3
  • Experience with deployment tooling such as Docker, Jenkins and Kubernetes
  • Experience with packaging and managing data for sale – data dictionaries, DMPs, and overlays
  • Experience with AI and ML frameworks
  • Experience with Enterprise integration, architecture, and white-label or multi-tenant deployments

What you will get from us:

  • Competitive compensation
  • Comprehensive, health, dental and vision plan
  • A great company culture
  • Be part of a diverse team
  • A fulfilling, challenging and flexible work experience
  • The opportunity for career growth
  • Stock Options
  • Wellness and Professional Development funds

Interested candidates should apply through the following links:

 

Killi welcomes and encourages applications from people with disabilities. Accommodations are available on request for candidates taking part in all aspects of the selection process.