Kafka Engineer

Position: Kafka EngineerLocation: Alpharetta, GA OR NYC, NY (for now required 3 days onsite/week)Duration: 12+ Months Looking for a Kafka Engineer who will provide subject matter expertise in the Architecture and deployment of Confluent Enterprise Kafka within organization. 50% architecture/lead capability.

• Experience designing secure and stable Kafka platforms.
• Physical deployment of infrastructure across multiple environments.
• Optimization and tuning of Kafka plant for peak performance.
• Standards and patterns development for Kafka usage.
• User guide development and training overviews for supporting teams.
• Provide troubleshooting and best practices methodology for development teams.
• Process automation and new application on-boarding, integration with CICD pipeline.
• Design monitoring solutions and baseline statistics reporting to support the implementation.
• Level 3 support for development teams that are utilizing the platform.
• Planning and execution of infrastructure projects as well as on-boarding of new application development projects
• Mentors L1/L2 support groups.
• Partner with development teams to provide Kafka

• Established track record with Kafka technology, with a deep understanding of the Kafka architecture and internals of how it works, along with interplay of architectural components: brokers, Zookeeper, producers/consumers, Kafka Connect, Kafka Streams
• Strong fundamentals in Kafka administration, configuration, and troubleshooting
• Knowledge of Kafka clustering, and its fault-tolerance model supporting HA and DR
• Practical experience with how to scale Kafka, KStreams, and Connector infrastructures, with the motivation to build efficient platforms
• Best practices to optimize the Kafka ecosystem based on use-case and workload
• Experience with Kafka Streams / KSQL architecture and associated clustering model
• Hands-on experience as a developer who has used the Kafka API to build producer and consumer applications, along with expertise in implementing KStreams components. Have developed KStreams pipelines, as well as deployed KStreams clusters
• Strong knowledge of the Kafka Connect framework, with experience using several connector types: HTTP REST proxy, JMS, File, SFTP, JDBC, Splunk, Salesforce, and how to support wire-format translations.
• Knowledge of connectors available from Confluent and the community would be a plus
• Hands-on experience in designing, writing, and operationalizing new Kafka Connectors using the framework
• Strong familiarity of wire formats such as XML, JSON, Avro, CSV, etc. along with serialization/deserialization options
• Familiarity of the Schema Registry