Skip to main content

Posts

Showing posts from November 7, 2024

Databrickls Lakehouse & Well Architect Notion

Let's quickly learn about Databricks, Lakehouse architecture and their integration with cloud service providers : What is Databricks? Databricks is a cloud-based data engineering platform that provides a unified analytics platform for data engineering, data science and data analytics. It's built on top of Apache Spark and supports various data sources, processing engines and data science frameworks. What is Lakehouse Architecture? Lakehouse architecture is a modern data architecture that combines the benefits of data lakes and data warehouses. It provides a centralized repository for storing and managing data in its raw, unprocessed form, while also supporting ACID transactions, schema enforcement and data governance. Key components of Lakehouse architecture: Data Lake: Stores raw, unprocessed data. Data Warehouse: Supports processed and curated data for analytics. Metadata Management: Tracks data lineage, schema and permissions. Data Governance: Ensures data quality, security ...

LIDAR Substitute in Robotics

LIDAR (Light Detection and Ranging) sensors are popular for robotic mapping, navigation and obstacle detection due to their high accuracy. However, they can be expensive and power-hungry. Here are some alternatives to LIDAR for your small robot: 1. Stereovision Stereovision uses two cameras to calculate depth information from the disparity between images. This method is less accurate than LIDAR but cheaper. 2. Structured Light Sensors Structured light sensors project a pattern onto the environment and measure distortions to calculate depth. Examples include Microsoft Kinect and Intel RealSense. 3. Time-of-Flight (ToF) Cameras ToF cameras measure depth by calculating the time difference between emitted and reflected light pulses. 4. Ultrasonic Sensors Ultrasonic sensors use sound waves to detect obstacles. They're inexpensive but less accurate and limited in range. 5. Infrared (IR) Sensors IR sensors detect obstacles by measuring reflected infrared radiation. They're simple and...