Data Specialist (Apahce Nifi) - R01525326

Primary Skills

• Asset Lifecycle Management, CITRIX, Collaboration - SharePoint, Data Center Management, Disaster Recovery, Jboss, Linux, MS Dynamics Life Cycle Services (LCS), O365 Administration, Release Management, SCOM/SCCM, Server Administration, Service Desk, Unix, VMWare Hybrid Cloud

Specialization

• Systems Engineering: Engineer, Applications & Platforms

Job requirements

• Job Title: Data Specialist (Apache Nifi) Job Description: We are seeking an experienced Enterprise Integration Engineer to join our team to implement and support enterprise integration using technologies such as Apache Nifi, Kafka, Kubernetes, and AWS. The primary responsibility of the Enterprise Integration Engineer will be to implement ingestion, validation, transformation to build vans inventory which includes CPO and new vans, monitor and operationalize the Product Import Engine (PIE), and support the team in capturing non-functional requirements. Key Responsibilities: • Implement ingestion, validation, and transformation to build vans inventory which includes CPO and new vans • Monitor and operationalize the Product Import Engine (PIE) • Support the team in capturing non-functional requirements • Develop architecture and design artifacts including Nifi implementation, service layer architecture, and data management strategy • Support team in the development of the system based on the design • Support team in testing and implementation of the application • Implement and leverage Kafka for PIE platform • Build streaming data pipelines using Kafka that reliably move data between systems • Experience in Postgres, REST APIs, JOLT transformations. • Implement event-driven processing for dealer data, migrate from batch processing • Support schema evolution between layers, implement Avro Schema Registry • Support PIE to ingest and post-processed data for any consumer systems/apps with publish/subscribe model • Publish processing errors into Kafka topic for source systems (Homenet) to address data issues • Evaluate Homenet (Cox Auto) readiness for this implementation and document any limitations that may require adjustments to the scope • Implement Release 3 and 4 functionality – New Car Inventory, and Enhancements Requirements: • Bachelor's or Master’s degree in Computer Science or related field • 8 years of experience in enterprise integration with event-driven architecture using technologies such as Nifi, Kafka, Kubernetes, and AWS • Experience in implementing ingestion, validation, and transformation processes • Experience in monitoring and operationalizing the Product Import Engine (PIE) • Strong understanding of service layer architecture and data management strategies • Experience in building streaming data pipelines using Kafka • Experience in implementing event-driven processing for dealer data, migrating from batch processing • Experience in implementing schema evolution between layers, implementing Avro Schema Registry • Experience in supporting PIE to ingest and post-processed data for any consumer systems/apps with publish/subscribe model • Strong problem-solving and analytical skills • Excellent written and verbal communication skills • Ability to work independently and in a team environment.