jobapplier

Senior Platform Engineer - ClickHouse

Qualys

Software Engineer (Data Platform, ClickHouse) We are seeking a highly motivated and talented Senior Software Engineer to work on Qualys’ next-generation Data Platform and middleware. For this position, we are looking for someone with expertise in ClickHouse. Working alongside a very talented team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable SaaS based cloud security Data Platform. This is a great opportunity to be an integral part of a team building Qualys’ next generation microservices based technology platform processing over a 100 million transactions and terabytes of data per day, leverage open source technologies, and work on challenging and business-impacting projects.

About Qualys

Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!

Responsibilities

  • For this position, we are especially looking for someone with below capabilities: Brings deep expertise in ClickHouse internals and architecture, various ClickHouse engines, partitioning, ordering keys, indexing, and query execution.
  • Design and review schemas against real-world read/write patterns, optimizing ingestion, query performance, and storage efficiency.
  • Operate ClickHouse at scale on premise or cloud, including replication, sharding, workload management, performance tuning, and production troubleshooting.
  • Drive capacity planning across CPU, memory, storage I/O, and network resources, accounting for workload growth, concurrency, background merges, and reliability requirements.
  • You will be responsible for engineering of services running data stored with millions of transactions per second, scaling to 100s of terabytes of data.
  • You will be responsible for driving the data source and providing data platform as a service to various applications built in Qualys.
  • Be the face and developer advocate of the technology stack you own and contribute back to open-source community if any enhancement needed to fit in Qualys ecosystem.
  • You will be instrumenting both day 1 and day 2 operations on these data technologies keeping the 100s of thousands if not millions of operations per second.
  • Migrate, burst into cloud and scale the stack with zero or least amount of downtime.
  • You will be responsible for delivering resilient client SDKs to the applications to communicate with the data source you are responsible for.
  • You will be constantly in the hunt for better solutions out there to resolve the current scaling, availability, and cost-effective alternative solutions.

Requirements

  • BS/MS degree in Computer Science, Applied Math or related field.
  • Experience and expertise in ClickHouse as outlined earlier 5+ years hands-on experience with developing SaaS based software products and solutions for service-oriented deployments in public (AWS, GCP, Azure, OCI, etc.) or private clouds.
  • Proven expertise in data-driven critical thinking problem-solving

Ability to debug systems of software and people

  • Demonstrated ability to write high-quality, production-ready code (readable, well-tested, with well-designed APIs) Demonstrated passion for innovation with an ability to work within agile software development methodologies
  • Experience with infrastructure orchestration and automation tools (Terraform) Hands-on experience using CI/CD pipelines
  • Strong analytical and debugging skills.
  • Java programming skills including object-oriented design, prototyping, development, testing, profiling, etc.
  • Knowledge of JVM concepts like garbage collection, heap, stack, profiling, class loading, etc.
  • Strong in data structures and algorithms.
  • Ability to clearly articulate and communicate technical concepts within and across teams.
  • Knowledge of the below is a plus Experience with distributed systems like Cassandra, Redis, Elasticsearch, Kafka, Ceph, Flink, Spark or similar technologies Experience with applying data encryption and data security standards.
  • Experience with container and orchestration technologies such as Docker, Kubernetes etc.
  • Experience with monitoring tools such as Graphite, Grafana and Prometheus.
  • Experience with HashiCorp technologies such as Consul, Vault, Terraform and Vagrant.
  • Experience with configuration management tools such as Chef, Puppet or Ansible.
  • In-depth experience with continuous integration and continuous deployment pipelines.

Pay

  • Exposure to Maven, Ant or Gradle for builds. * The salary range for this position is $125,000 - $145,000 per year.
  • Final compensation will be determined based on several factors, including but not limited to skills, relevant experience, and work location.
  • Please note this range reflects base salary and does not include incentive compensation or potential equity grants.

Benefits

  • We also offer a comprehensive and highly competitive benefits package.

Qualys is an Equal Opportunity Employer, please see our EEO policy .