AI & Data solution engineer

Job Description

Key Responsibilities: Continuously research, evaluate, and explore new and emerging data technologies (e.g., AI, machine learning, blockchain, edge computing) to identify opportunities for innovation. Stay current on industry trends, tools, and best practices related to big data, cloud data platforms, real-time analytics, and data science . Design and implement innovative data architectures that support scalable data pipelines, data lakes, and advanced cloud-native data solutions. Develop and integrate solutions using cutting-edge tools such as Hadoop, Spark, Kafka, Databricks, and Snowflake to handle massive datasets and real-time data streaming. Implement modern data integration and real-time data streaming frameworks to ensure continuous data flow and high availability of data. Utilize containerization and orchestration tools (e.g., Docker, Kubernetes) for scalable deployment of data pipelines. Work on developing automated data workflows that leverage AI/ML to provide real-time insights, recommendations, and forecasting. Lead efforts to migrate data ecosystems to the cloud, leveraging platforms like AWS, Azure, or Google Cloud. Design and implement cloud-native data pipelines and serverless architectures to support scalability, performance, and cost-efficiency. Develop proof of concepts (PoCs) and minimum viable products (MVPs) for innovative data solutions that demonstrate the capabilities of emerging technologies. Rapidly prototype and test new ideas to validate their impact on business processes and decision-making.