Data Scientist Company : Blackstraw.ai Job location: Chennai (Work from Office) Job Type: Full-time Experience: 2 10 Years Job Summary: We are looking for Data Scientists to analyze large amounts of raw information to find patterns that will help improve our clients business. We will rely on you to build data products to extract valuable business insights. You will be part of our AI team in developing AI based products through the latest cutting edge technology. Key Responsibilities: Identify valuable data sources and automate collection processes Undertake preprocessing of structured and unstructured data Analyze large amounts of information to discover trends and patterns Build predictive models and machine-learning algorithms Combine models through ensemble modeling Present information using data visualization techniques Propose solutions and strategies to business challenges Collaborate with engineering and product development teams Communicate your findings to the appropriate teams through visualisations Collaborate and communicate findings to diverse stakeholders Provide solutions but not limited to: Object detection/Image recognition, natural language processing, Sentiment Analysis, Topic Modeling, Concept Extraction, Recommender Systems, Text Classification, Clustering , Customer Segmentation Targeting, Propensity Modeling, Churn Modeling, Lifetime Value Estimation, Forecasting, Modeling Response to Incentives, Marketing Mix Optimization, Price Optimization. Follow/maintain an agile methodology for delivering on project milestones. Excellent oral, presentation, and written communication skills. Preferred Qualifications: Bachelors in Math, Computer Science, Information Systems, Machine Learning, Statistics, Econometrics, Applied Mathematics, Operations Research or related technical degree with ability to break complex business problems down to smaller more solvable parts. Minimum of 3+ years of experience in a related position, as a data scientist building predictive analytics or NLP or CV solutions for various types of business problems. Working knowledge of statistical techniques, NLP, machine learning algorithms and deep learning frameworks like Tensorflow, Pytorch, PySpark. Programming background and expertise in building models using at least one of the following languages: Python, R , C, C++, Spark, Scala. Good knowledge in the implementation of deep learning models for image classification, Document classification models, object detection, logo detection. Self-motivated and driven to deliver agreed results on-time. Company Profile: Conceptualized as far back as 2015, and commencing full-time operations in 2018, Blackstraw technologies Pvt Ltd. is a software products and services company specializing in Artificial Intelligence (AI) and Machine Learning solutions for various industries. We support businesses around the world, including North America, Europe and Asia, working to simplify AI implementation through our platform that expedites data labelling, AI model-training, and cloud or on-premise deployments. With more than 900 years of combined work-experience, the 250+-strong Blackstraw Team comprises various experts in the AI value chain. We are a fast-moving team that prides ourselves in rapidly identifying different use-cases and fine-tuning our products to suit specific business needs. We are focused on providing solutions related to computer vision, natural language processing, Data annotation tools for deep learning models, etc. To stay competitive in business, it is key for organizations to adopt and implement smart AI solutions and service offerings. However, most companies are unable to implement AI rapidly due to the complexity of existing solutions, inadequate data and cost implications. Our mission is to enable enterprises to adopt AI in an easier, cost-effective and time-efficient manner with a plug-and-play approach to their data.

Data Engineering LeadCompany Name: Blackstraw.aiOce Location: Chennai (Work from Office)Job Type: Full-timeExperience: 10 - 15 YearsCandidates who can join immediately will be preferred.Job Description: As a lead data engineer you will oversee data architecture, ETL processes, and analyticspipelines, ensuring efficiency, scalability, and quality. Key Responsibilities: Working with clients to understand their data. Based on the understanding you will be building the data structures and pipelines. You will be working on the application from end to end collaborating with UI and other development teams. You will be working with various cloud providers such as Azure & AWS. You will be engineering data using the Hadoop/Spark ecosystem. You will be responsible for designing, building, optimizing and supporting new and existing datapipelines. Orchestrating jobs using various tools such Oozie, Airflow, etc. Developing programs for cleaning and processing data. You will be responsible for building the data pipelines to migrate and load the data into the HDFSeither on-prem or in the cloud. Developing Data ingestion/process/integration pipelines effectively. Creating Hive data structures,metadata and loading the data into data lakes / BigData warehouse environments. Optimized (Performance tuning) many data pipelines effectively to minimize cost. Code versioning control and git repository is up to date. You should be able to explain the data pipeline to internal and external stakeholders. You will be responsible for building and maintaining CI/CD of the data pipelines. You will be managing the unit testing of all data pipelines.Tech Stack: Minimum of 5+ years working experience with Spark, Hadoop eco systems. Minimum of 4+ years working experience on designing data streaming pipelines. Should be an expert in either Python/Scala/Java. Should have experience in Data Ingestion and Integration into data lake using hadoop ecosystemtools such as Sqoop, Spark, SQL, Hive, Airflow, etc.. Should have experience optimizing (Performance tuning) data pipelines. Should have minimum experience of 3+ years on NoSQL and Spark Streaming. Knowledge of Kubernetes and Docker is a plus. Should have experience with Cloud services either Azure/AWS. Should have experience with on-prem distribution such as Cloudera/HortonWorks/MapR. Basic understanding of CI/CD pipelines. Basic knowledge of Linux environment and commands.Preferred Qualifications: Bachelors degree in computer science or related field. Proven experience with big data ecosystem tools such as Sqoop, Spark, SQL, API, Hive, Oozie,Airflow, etc.. Solid experience in all phases of SDLC with 10+ years of experience (plan, design, develop, test,release, maintain and support) Hands-on experience using Azures data engineering stack. Should have implemented projects using programming languages such as Scala or Python. Working experience on SQL complex data merging techniques such as windowing functions etc.. Hands-on experience with on-prem distribution tools such as Cloudera/HortonWorks/MapR. Should have excellent communication, presentation and problem solving skills.Key Traits: Should have excellent communication skills. Should be self motivated and willing to work as part of a team. Should be able to collaborate and coordinate with on shore and offshore teams. Be a problem solver and be proactive to solve the challenges that come his way.

We are looking for a Senior Data Engineer to join our team. You will use various methods to transform raw data into useful data systems. You'll strive for efficiency by aligning data systems with business goals.To succeed in this position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and an understanding of machine learning methods.If you are detail-oriented, with excellent organizational skills and experience in this field, wed like to hear from you.Job RequirementsParticipate in the customer's system design meetings and collect the functional/technical requirements.Responsible to meet the customer expectations on real-time data integrity and implementing efficient solutionsA clear understanding of Spark, Hive, Kafka, and RDBMS architecture.Experience in writing Scala/Python programs and SQL queries.Suggest and implement best practices in data integration.Guide the QA team in defining system integration tests as needed.Split the planned deliverables into tasks and assign them to the team.Good to have:Knowledge of CI/CD concepts, Apache KafkaKey traits:Should have excellent communication skills.Should be self-motivated and willing to work as part of a team.Should be able to collaborate and coordinate in a remote environment.Be a problem solver and be proactive to solve the challenges that come his way.

Job Responsibility: We are looking for dynamic Lead Full Stack Engineers/Tech Leads for our Chennai location. The candidate must have extensive experience in developing and deploying web applications using modern web technologies. The candidate must also have experience in leading a team of engineers, collaborating with stakeholders, and designing core architecture of applications.Qualifications/Tech StackBachelor's or master's degree in Computer Science or a related field7+ years of experience in developing and deploying web applications using web technologies such as Angular, React, Node.js,3+ years of experience in leading development teamsExperience with Agile software development methodologies and toolsExcellent communication skills and the ability to mentor and grow a teamAbility to provide clear technical direction to senior leaders within Blackstraw and our clientsExperience working across the full life-cycle of application development, from design to deploymentA passion for technology and a drive to learn new skills and stay up-to-date with emerging trends in the industry

About Us: We are a dynamic and innovative team specializing in building scalable and efficient web scraping solutions for complex e-commerce platforms and diverse web environments. Our team is proficient in a wide range of technologies and advanced web scraping techniques, ensuring high-quality data extraction and delivery Job Summary: We are seeking a talented Web Scraping Engineer / Data Extraction Specialist to join our growing team. The ideal candidate will have a strong background in web scraping, data extraction, and backend technologies. You will be responsible for designing, developing, and maintaining robust web scraping solutions, handling dynamic content, and overcoming anti-crawling measures. Responsibilities: Develop and maintain scalable web scraping scripts using Python, JavaScript, and related frameworks (e.g., Scrapy, Selenium, Puppeteer, Beautiful Soup, Cheerio.js). Implement advanced web scraping techniques, including API interception, sitemap parsing, and handling dynamic content. Design and build data pipelines for efficient data extraction, processing, and storage. Manage and optimize data extraction workflows, ensuring high speed and accuracy. Implement anti-crawling solutions, including IP rotation, proxy management, and CAPTCHA bypassing. Collaborate with cross-functional teams to gather requirements and deliver complex data solutions. Utilize backend technologies such as Flask, FastAPI, Django, Node.js, Spring Boot, and relational databases (PostgreSQL, MySQL) for data storage and API development. Work with cloud platforms like Azure and leverage services such as AzureML and ADLS GEN2. Employ data processing techniques using libraries like NumPy and Pandas. Use tools like Postman, MITM, and DevTools for API testing and network traffic analysis. Apply machine learning and NLP techniques for data analysis and processing (e.g., sentiment analysis, content classification). Set up and manage server-side scraping environments. Monitor and troubleshoot scraping scripts to ensure optimal performance. Required Skills: Strong proficiency in Python and/or JavaScript. Experience with web scraping libraries and frameworks (Scrapy, Selenium, Puppeteer, Beautiful Soup, Cheerio.js). Knowledge of backend technologies (Flask, FastAPI, Django, Node.js, Spring Boot). Experience with relational databases (PostgreSQL, MySQL). Understanding of HTTP/HTTPS protocols and API communication. Familiarity with cloud platforms (Azure). Ability to handle dynamic content and JavaScript-heavy websites. Experience with anti-crawling techniques (IP rotation, proxies, CAPTCHA bypassing). Data processing and analysis skills (NumPy, Pandas). Experience with API testing tools (Postman). Knowledge of machine learning and NLP concepts is a plus. Strong problem-solving and debugging skills. Excellent communication and collaboration skills. Experience: 5+ years of professional experience in web scraping or related fields. Education: Bachelor's degree in Computer Science, Engineering, or a related field

Bachelor's degree in Computer Science, Information Technology with 5+ years of equivalent experience. Minimum of 5 years of JAVA development.Experience with development methodologies such as Agile or SCRUMMust have solid experience in the following items: Core Java, Java 8, Spring, Spring Boot, REST API , GIT, Hibernate , Design Pattern JPA, Postgre, Azure, Jenkins, Maven.Excellent knowledge of Relational Databases, SQL and ORM technologies (JPA2, Hibernate, etc..)Working knowledge of version control software such as Git, SVN etc...Hands on experience with API developmentKnowledge of Microservices will be a bonus.Strong working experience with Java and JEE internals (Classloading, Memory Management, Transaction management, Resource Management, Multi Threading, etc...)

Responsibilities Ability to build and lead a team of data scientists. You would be required to Identify, develop and implement the appropriate statistical modeling, ML/Deep learning Models to create new, scalable solutions that address business challenges across industry domains. Create business stories and presentation through Data Inferential Analysis Define, develop, maintain and evolve data models, tools and capabilities. Communicate your findings to the appropriate teams through visualizations Collaborate and communicate findings to diverse stakeholders Required Implementation Bachelors/ Masters/ PhD degree in Math, Computer Science, Information Systems, Machine Learning, Statistics, Applied Mathematics or related technical degree. 8 plus years total experience with minimum of 3 years of experience in a related position, as a Data Scientist or ML Engineer building Predictive analytics and Machine Learning solutions for various types of business problems. Advanced knowledge of Statistical Modeling, Machine Learning Algorithms, Python Programming Strong individual planning and project management skills, able to work on more than one responsibilities through right prioritization Self-motivated and driven to deliver agreed results on-time Ability to convert analytical output into clear, concise, and persuasive insights & recommendations for technical & non-technical audience