Skip to main content

Posts

From Unstructure Data to Data Model

Collecting and preparing unstructured data for data modelling involves several steps. Here's a step-by-step guide with a basic example for illustration: Step 1: Define Data Sources Identify the sources from which you want to collect unstructured data. These sources can include text documents, images, audio files, social media feeds, and more. For this example, let's consider collecting text data from social media posts. Step 2: Data Collection To collect unstructured text data from social media, you can use APIs provided by platforms like Twitter, Facebook, or Instagram. For this example, we'll use the Tweepy library to collect tweets from Twitter. ```python import tweepy # Authenticate with Twitter API consumer_key = 'your_consumer_key' consumer_secret = 'your_consumer_secret' access_token = 'your_access_token' access_token_secret = 'your_access_token_secret' auth = tweepy.OAuthHandler(consumer_key, consumer_secret) auth.set_access_token(acc...

You Can Pursue Data Science Career Even Not From Pure Mathematics Background

Certainly, several career options within the field of data science don't require advanced mathematical skills. While mathematics plays a significant role in certain aspects of data science, some roles and subfields emphasize other skills and expertise. Here are some data science career options that may be suitable for individuals with limited mathematical background: 1. Data Analyst: Data analysts primarily focus on interpreting and visualizing data to provide actionable insights. While some statistical knowledge is helpful, you don't need advanced mathematics. Proficiency in tools like Excel, SQL, and data visualization tools (e.g., Tableau, Power BI) is essential. 2. Business Intelligence Analyst: Business intelligence analysts work with data to help organizations make informed business decisions. They use data visualization tools and SQL to create reports and dashboards. 3. Data Engineer: Data engineers are responsible for collecting, storing, and maintaining data for ana...

ML Ops in Azure

Setting up MLOps (Machine Learning Operations) in Azure involves creating a continuous integration and continuous deployment (CI/CD) pipeline to manage machine learning models efficiently. Below, I'll provide a step-by-step guide to creating an MLOps pipeline in Azure using Azure Machine Learning Services, Azure DevOps, and Azure Kubernetes Service (AKS) as an example. This example assumes you already have an Azure subscription and some knowledge of Azure services. You can check out for FREE learning resources at https://learn.microsoft.com/en-us/training/azure/ Step 1: Prepare Your Environment Before you start, make sure you have the following: - An Azure subscription. - An Azure DevOps organization. - Azure Machine Learning Workspace set up. Step 2: Create an Azure DevOps Project 1. Go to Azure DevOps (https://dev.azure.com/) and sign in. 2. Create a new project that will host your MLOps pipeline. Step 3: Set Up Your Azure DevOps Repository 1. In your Azure DevOps project, creat...