Azure CLI

 account : Manage Azure subscription information.

  acr         : Manage private registries with Azure Container Registries.

  ad         : Manage Azure Active Directory Graph entities needed for Role Based Access

             Control.

  advisor       : Manage Azure Advisor.

  afd         : Manage Azure Front Door Standard/Premium.

  ai-examples     : Add AI powered examples to help content.

  aks         : Manage Azure Kubernetes Services.

  ams         : Manage Azure Media Services resources.

  apim        : Manage Azure API Management services.

  appconfig      : Manage App Configurations.

  appservice     : Manage App Service plans.

  aro         : Manage Azure Red Hat OpenShift clusters.

  backup       : Manage Azure Backups.

  batch        : Manage Azure Batch.

  bicep        : Bicep CLI command group.

  billing       : Manage Azure Billing.

  bot         : Manage Microsoft Azure Bot Service.

  cache        : Commands to manage CLI objects cached using the `--defer` argument.

  capacity      : Manage capacity.

  cdn         : Manage Azure Content Delivery Networks (CDNs).

  cloud        : Manage registered Azure clouds.

  cognitiveservices  : Manage Azure Cognitive Services accounts.

  config       : Manage Azure CLI configuration.

  configure      : Manage Azure CLI configuration. This command is interactive.

  connection     : Commands to manage Service Connector local connections which allow local

             environment to connect Azure Resource. If you want to manage connection for

             compute service, please run 'az webapp/containerapp/spring connection'.

  consumption     : Manage consumption of Azure resources.

  container      : Manage Azure Container Instances.

  containerapp    : Manage Azure Container Apps.

  cosmosdb      : Manage Azure Cosmos DB database accounts.

  databoxedge     : Support data box edge device and management.

  deployment     : Manage Azure Resource Manager template deployment at subscription scope.

  deployment-scripts : Manage deployment scripts at subscription or resource group scope.

  disk        : Manage Azure Managed Disks.

  disk-access     : Manage disk access resources.

  disk-encryption-set : Disk Encryption Set resource.

  dla         : Manage Data Lake Analytics accounts, jobs, and catalogs.

  dls         : Manage Data Lake Store accounts and filesystems.

  dms         : Manage Azure Data Migration Service (classic) instances.

  eventgrid      : Manage Azure Event Grid topics, domains, domain topics, system topics

             partner topics, event subscriptions, system topic event subscriptions and

             partner topic event subscriptions.

  eventhubs      : Eventhubs.

  extension      : Manage and update CLI extensions.

  feature       : Manage resource provider features.

  feedback      : Send feedback to the Azure CLI Team.

  find        : I'm an AI robot, my advice is based on our Azure documentation as well as

             the usage patterns of Azure CLI and Azure ARM users. Using me improves

             Azure products and documentation.

  functionapp     : Manage function apps. To install the Azure Functions Core tools see

             https://github.com/Azure/azure-functions-core-tools.

  group        : Manage resource groups and template deployments.

  hdinsight      : Manage HDInsight resources.

  identity      : Managed Identities.

  image        : Manage custom virtual machine images.

  interactive     : Start interactive mode. Installs the Interactive extension if not

             installed already.

  iot         : Manage Internet of Things (IoT) assets.

  keyvault      : Manage KeyVault keys, secrets, and certificates.

  kusto        : Manage Azure Kusto resources.

  lab         : Manage Azure DevTest Labs.

  lock        : Manage Azure locks.

  logicapp      : Manage logic apps.

  login        : Log in to Azure.

  logout       : Log out to remove access to Azure subscriptions.

  managed-cassandra  : Azure Managed Cassandra.

  managedapp     : Manage template solutions provided and maintained by Independent Software

             Vendors (ISVs).

  managedservices   : Manage the registration assignments and definitions in Azure.

  maps        : Manage Azure Maps.

  mariadb       : Manage Azure Database for MariaDB servers.

  ml         : Manage Azure Machine Learning resources with the Azure CLI ML extension

             v2.

  monitor       : Manage the Azure Monitor Service.

  mysql        : Manage Azure Database for MySQL servers.

  netappfiles     : Manage Azure NetApp Files (ANF) Resources.

  network       : Manage Azure Network resources.

  policy       : Manage resource policies.

  postgres      : Manage Azure Database for PostgreSQL servers.

  ppg         : Manage Proximity Placement Groups.

  private-link    : Private-link association CLI command group.

  provider      : Manage resource providers.

  redis        : Manage dedicated Redis caches for your Azure applications.

  relay        : Manage Azure Relay Service namespaces, WCF relays, hybrid connections, and

             rules.

  resource      : Manage Azure resources.

  resourcemanagement : Resourcemanagement CLI command group.

  rest        : Invoke a custom request.

  restore-point    : Manage restore point with res.

  role        : Manage user roles for access control with Azure Active Directory and

             service principals.

  search       : Manage Azure Search services, admin keys and query keys.

  security      : Manage your security posture with Microsoft Defender for Cloud.

  servicebus     : Servicebus.

  sf         : Manage and administer Azure Service Fabric clusters.

  sig         : Manage shared image gallery.

  signalr       : Manage Azure SignalR Service.

  snapshot      : Manage point-in-time copies of managed disks, native blobs, or other

             snapshots.

  sql         : Manage Azure SQL Databases and Data Warehouses.

  ssh         : SSH into resources (Azure VMs, Arc servers, etc) using AAD issued openssh

             certificates.

  sshkey       : Manage ssh public key with vm.

  stack        : A deployment stack is a native Azure resource type that enables you to

             perform operations on a resource collection as an atomic unit.

  staticwebapp    : Manage static apps.

  storage       : Manage Azure Cloud Storage resources.

  survey       : Take Azure CLI survey.

  synapse       : Manage and operate Synapse Workspace, Spark Pool, SQL Pool.

  tag         : Tag Management on a resource.

  term        : Manage marketplace agreement with marketplaceordering.

  ts         : Manage template specs at subscription or resource group scope.

  upgrade       : Upgrade Azure CLI and extensions.

  version       : Show the versions of Azure CLI modules and extensions in JSON format by

             default or format configured by --output.

  vm         : Manage Linux or Windows virtual machines.

  vmss        : Manage groupings of virtual machines in an Azure Virtual Machine Scale Set

             (VMSS).

  webapp       : Manage web apps.

Azure platform for machine learning and generative AI RAG

Connecting on-premises data to the Azure platform for machine learning and generative AI Retrieval Augmented Generation (RAG) involves several steps. Here’s a step-by-step guide:

Step 1: Set Up Azure Machine Learning Workspace

1. Create an Azure Machine Learning Workspace: This is your central place for managing all your machine learning resources.

2. Configure Managed Virtual Network: Ensure your workspace is set up with a managed virtual network for secure access to on-premises resources.

Step 2: Establish Secure Connection

1. Install Azure Data Gateway: Set up an Azure Data Gateway on your on-premises network to securely connect to Azure.

2. Configure Application Gateway: Use Azure Application Gateway to route and secure communication between your on-premises data and Azure workspace.

Step 3: Connect On-Premises Data Sources

1. Create Data Connections: Use Azure Machine Learning to create connections to your on-premises data sources, such as SQL Server or Snowflake - Azure Machine ...](https://learn.microsoft.com/en-us/azure/machine-learning/how-to-connection?view=azureml-api-2).

2. Store Credentials Securely: Store credentials in Azure Key Vault to ensure secure access - Azure Machine ...](https://learn.microsoft.com/en-us/azure/machine-learning/how-to-connection?view=azureml-api-2).

Step 4: Data Integration and Processing

1. Data Ingestion: Use Azure Databricks or Azure Machine Learning Studio to ingest data from your on-premises sources on Azure Databricks](https://learn.microsoft.com/en-us/azure/databricks/generative-ai/retrieval-augmented-generation).

2. Data Processing: Clean, transform, and preprocess your data using Azure Databricks or Azure Machine Learning tools.

Step 5: Build and Train Models

1. Model Development: Develop your machine learning models using Azure Machine Learning Studio or Azure Databricks on Azure Databricks](https://learn.microsoft.com/en-us/azure/databricks/generative-ai/retrieval-augmented-generation).

2. Model Training: Train your models on the processed data on Azure Databricks](https://learn.microsoft.com/en-us/azure/databricks/generative-ai/retrieval-augmented-generation).

Step 6: Deploy and Monitor Models

1. Model Deployment: Deploy your trained models to Azure Machine Learning for real-time predictions.

2. Monitoring and Management: Use Azure Monitor and Azure Machine Learning to monitor model performance and manage deployments.

Step 7: Implement RAG

1. Integrate with Azure AI Search: Use Azure AI Search for indexing and retrieving relevant data for your RAG system.

2. Use Azure OpenAI Service: Integrate with Azure OpenAI Service for generative AI capabilities.

3. Customize RAG Workflow: Design a custom RAG workflow using Azure AI Search, Azure OpenAI, and other Azure tools to enhance your generative AI applications.

Azure Data Lake Storage Gen2 (ADLS Gen2) is an excellent choice for storing unstructured data. It combines the capabilities of Azure Blob Storage and Azure Data Lake Storage, making it suitable for big data analytics. Here’s how you can make the most of it:

Key Features

- Scalability: It can handle large volumes of unstructured data, scaling as needed.

- Integration: Seamlessly integrates with Azure services like Azure Machine Learning, Databricks, and Synapse Analytics.

- Security: Provides robust security features, including encryption and access control, to protect your data.

- Cost-Effectiveness: Offers tiered storage options to optimize costs based on data access patterns.

How to Use ADLS Gen2 for Unstructured Data

1. Set Up Storage Account: Create an Azure Storage account with hierarchical namespace enabled.

2. Create Containers: Organize your data by creating containers within the storage account.

3. Upload Data: Use tools like Azure Storage Explorer or Azure CLI to upload your unstructured data (e.g., logs, images, videos).

4. Access Data: Access your data using various Azure services and tools for processing and analytics.

5. Manage and Monitor: Use Azure Monitor and Azure Security Center to manage and monitor your data lake.

Integration with AI/ML Tools

1. Azure Machine Learning: Store training data and results in ADLS Gen2, and use it directly from Azure Machine Learning for model training and experimentation.

2. Azure Databricks: Leverage Databricks to process and analyze unstructured data stored in ADLS Gen2 using Spark.

3. Azure Synapse Analytics: Use Synapse to query and analyze large datasets stored in ADLS Gen2, combining it with structured data sources.

Using ADLS Gen2 ensures you have a scalable, secure, and integrated solution for managing unstructured data, making it an ideal choice for your AI and ML projects. 

Azure Networking

 

                                                                                Azure

Azure's networking services offer a comprehensive suite of capabilities to connect, protect, deliver, and monitor your applications and networks. Whether you need to connect on-premises resources to the cloud, safeguard your applications from cyberattacks, optimize application performance, or gain insights into network traffic, Azure's networking solutions have you covered.

Connectivity Services:

• Virtual Network (VNet): Create a private network in the cloud to isolate and protect your Azure resources.

• Virtual WAN: Establish a secure and reliable connection between your on-premises network, branch offices, and Azure resources.

• ExpressRoute: Connect your on-premises network to Azure using a private connection.

• VPN Gateway: Create a VPN tunnel to connect your on-premises network to Azure securely over the public internet.

• Virtual Network NAT Gateway: Enable outbound internet access for your Azure resources without exposing them to the public internet.

• Azure DNS: Manage your domain names and DNS records in Azure.

• Peering Service: Connect two virtual networks in Azure to share resources.

• Azure Virtual Network Manager: Manage and control multiple virtual networks in Azure centrally.

• Route Server: Simplify route management for large virtual networks in Azure.

• Azure Bastion: Enable secure remote access to virtual machines in Azure.

Application Protection Services:

• Load Balancer: Distribute incoming traffic across multiple instances of your application to improve performance and availability.

• Private Link: Connect to Azure services privately without exposing them to the public internet.

• DDoS Protection: Safeguard your applications from distributed denial-of-service (DDoS) attacks.

• Firewall: Protect your applications from unauthorized access and malicious traffic.

• Network Security Groups: Control inbound and outbound traffic to your Azure resources.

• Web Application Firewall (WAF): Protect web applications from common web attacks.

• Virtual Network Endpoints: Connect to Azure services without exposing them to the public internet.

Application Delivery Services:

• Content Delivery Network (CDN): Cache your static content at strategically located edge servers worldwide to deliver it quickly to users.

• Azure Front Door Service: Protect, route, and optimize traffic for your web applications.

• Traffic Manager: Distribute traffic across multiple regions and cloud providers to ensure high availability and performance.

• Application Gateway: Manage routing, authentication, and load balancing for your web applications.

• Internet Analyzer: Gain insights into the performance and health of your web applications from a user's perspective.

• Load Balancer: Distribute incoming traffic across multiple instances of your application to improve performance and availability.

Network Monitoring:

• Network Watcher: Collect network traffic logs and troubleshoot network issues.

• ExpressRoute Monitor: Monitor the health and performance of your ExpressRoute connection.

• Azure Monitor: Gain insights into the health and performance of your Azure resources, including your network.

• VNet Terminal Access Point (TAP): Create a copy of network traffic for monitoring and analysis.

1. Connectivity Services:

Virtual Network (VNet):

- Description:

  - Allows you to create private, isolated networks in Azure.

- Example:

  - Creating a VNet in the Azure portal:

    - Go to the Azure portal.

    - In the left-hand menu, click on "Create a resource" > "Networking" > "Virtual network."

ExpressRoute:

- Description:

  - Provides dedicated, private network connectivity between on-premises datacenters and Azure.

- Example:

  - Setting up ExpressRoute circuits:

    - Configure ExpressRoute circuits in the Azure portal.

VPN Gateway:

- Description:

  - Enables secure connections between on-premises networks and Azure VNets.

- Example:

  - Configuring a VPN Gateway in the Azure portal:

    - Create a VPN Gateway to connect on-premises and Azure networks.

Azure DNS:

- Description:

  - A scalable and secure domain name system (DNS) service.

- Example:

  - Adding DNS records:

    - Manage DNS records for your resources in the Azure portal.

2. Application Protection Services:

Load Balancer:

- Description:

  - Distributes network traffic across multiple servers to ensure no single server is overwhelmed.

- Example:

  - Configuring a Load Balancer:

    - Set up a Load Balancer to distribute traffic among backend servers.

Private Link:

- Description:

  - Enables secure access to Azure services over a private connection.

- Example:

  - Creating a Private Link service:

    - Link a specific Azure service to your VNet.

DDoS Protection:

- Description:

  - Protects applications from Distributed Denial of Service (DDoS) attacks.

- Example:

  - Enabling DDoS Protection:

    - Enable DDoS Protection for your resources in the Azure portal.

Firewall:

- Description:

  - A network security feature that filters and logs traffic.

- Example:

  - Setting up Azure Firewall:

    - Deploy Azure Firewall to control outbound and inbound traffic.

3. Application Delivery Services:

Content Delivery Network (CDN):

- Description:

  - A distributed network of servers that delivers web content to users based on their geographic location.

- Example:

  - Configuring CDN for a Storage Account:

    - Use CDN to deliver content from an Azure Storage Account.

Azure Front Door Service:

- Description:

  - A global, scalable entry-point for fast and secure delivery of applications.

- Example:

  - Setting up Azure Front Door:

    - Configure Azure Front Door to improve application performance and availability.

Traffic Manager:

- Description:

  - Distributes user traffic across multiple hosted Azure services.

- Example:

  - Configuring Traffic Manager:

    - Set up Traffic Manager for global load balancing.

Application Gateway:

- Description:

  - Provides application-level routing, load balancing, and web application firewall.

- Example:

  - Deploying Application Gateway:

    - Use Application Gateway for SSL termination and routing.

4. Network Monitoring:

Network Watcher:

- Description:

  - Provides tools to monitor, diagnose, and gain insights into your Azure network.

- Example:

  - Using Network Watcher tools:

    - Utilize tools like "IP Flow Verify" or "Connection Monitor" for network troubleshooting.

Azure Monitor:

- Description:

  - A comprehensive solution for collecting, analyzing, and acting on telemetry data from Azure resources.

- Example:

  - Setting up Azure Monitor:

    - Configure monitoring for your Azure resources.

VNet Terminal Access Point (TAP):

- Description:

  - A monitoring feature that captures and inspects the traffic of a virtual machine.

- Example:

  - Configuring TAP:

    - Set up a TAP to capture and analyze network traffic.

These examples provide a starting point for understanding and implementing various Azure networking services based on the outlined topics. Adjust configurations based on your specific requirements and security considerations.