Big Data Developer

Job Description

Usxi is Looking for Big Data Developers that will work on the collecting, storing, processing, and analyzing of huge sets of data. The Data Developers must also have exceptional analytical skills, showing fluency in the use of tools such as MySQL and strong Python, Shell, Java, PHP, and T-SQL programming skills. The candidate must also be technologically adept, demonstrating strong computer skills. Additionally, you must be capable of developing databases using SSIS packages, T-SQL, MSSQL, and MySQL scripts. The candidate will also have an ability to design, build, and maintain the businesss ETL pipeline and data warehouse. The candidate will also demonstrate expertise in data modeling and query performance tuning on SQL Server, MySQL, Redshift, Postgres or similar platforms. Key responsibilities will include: Develop and maintain data pipelines Design and implement ETL processes Hands on experience on Data Modeling – Design conceptual, logical and physical data models with type 1 and type2 dimension s. Knowledge to move the ETL code base from On-premise to Cloud Architecture Understanding data lineage and governance for different data sources Maintaining clean and consistent access to all our data sources Hands on experience to deploy the code using CI/CD pipelines Assemble large and complex data sets strategically to meet business requirements Enable business users to bring data-driven insights into their business decisions through reports and dashboards Required Qualifications: Hands on experience in big data technologies including Scala or Spark (Azure Databricks preferable), Hadoop, Hive, HDFS. Python, Java & SQL Knowledge of Microsoft’s Azure Cloud Experience and commitment to development and testing best practices. DevOps experience with continuous integration/delivery best-practices, technologies and tools. Experienced deploying Azure SQL Database, Azure Data Factory and well-acquainted with other Azure services including Azure Data Lake and Azure ML Experience implementing REST API calls and authentication Experienced working with agile project management methodologies Computer Science Degree/Diploma Microsoft Certified: DP203 - Azure Data Engineer Associate