Channel Membership Announcement | 5K Subscribers |Thanks for your support!!
Anjan GCP Data Engineering
Channel Membership Announcement | 5K Subscribers |Thanks for your support!!
1:19
Google Cloud Storage blazing fast uploads and downloads with Python client libraries
Anjan GCP Data Engineering
Google Cloud Storage blazing fast uploads and downloads with Python client libraries
14:04
Data Lineage | Track Big Query table data Lineage
Anjan GCP Data Engineering
Data Lineage | Track Big Query table data Lineage
16:34
Write Big Query SQL queries with Gemini assistance
Anjan GCP Data Engineering
Write Big Query SQL queries with Gemini assistance
11:30
Basics of Service Accounts and IAM Roles
Anjan GCP Data Engineering
Basics of Service Accounts and IAM Roles
26:11
Big Query BigLake Tables
Anjan GCP Data Engineering
Big Query BigLake Tables
16:02
Learn code free Data pipelines with Cloud Data Fusion | Packed with detailed Demos and explanations
Anjan GCP Data Engineering
Learn code free Data pipelines with Cloud Data Fusion | Packed with detailed Demos and explanations
1:11:25
Serverless Change Data Capture (CDC) , Replication , Data Synchronisation with Cloud Datastream
Anjan GCP Data Engineering
Serverless Change Data Capture (CDC) , Replication , Data Synchronisation with Cloud Datastream
24:58
Copy GCS Bucket using Storage Transfer Job #dataengineeringessentials
Anjan GCP Data Engineering
Copy GCS Bucket using Storage Transfer Job #dataengineeringessentials
1:00
ETL nested AVRO files into Cloud SQL, GCS using Dataflow Pipeline
Anjan GCP Data Engineering
ETL nested AVRO files into Cloud SQL, GCS using Dataflow Pipeline
33:43
Apache Beam Session Windows #dataengineeringessentials
Anjan GCP Data Engineering
Apache Beam Session Windows #dataengineeringessentials
0:55
Apache Beam Sliding Windows #dataengineeringessentials
Anjan GCP Data Engineering
Apache Beam Sliding Windows #dataengineeringessentials
0:55
Automate GCP Project’s IAM Roles Snapshot process using Cloud Functions, Bigquery, Cloud Scheduler
Anjan GCP Data Engineering
Automate GCP Project’s IAM Roles Snapshot process using Cloud Functions, Bigquery, Cloud Scheduler
14:56
Schedule Queries for routine tasks in Big Query
Anjan GCP Data Engineering
Schedule Queries for routine tasks in Big Query
0:56
Quick understanding of Dataflow Fixed Windows with example.
Anjan GCP Data Engineering
Quick understanding of Dataflow Fixed Windows with example.
0:59
Quick Bigquery Table upload into GCS Bucket
Anjan GCP Data Engineering
Quick Bigquery Table upload into GCS Bucket
0:51
GCP Professional Data Engineer, re certified ,Exam experience and my suggestions to Aspirants
Anjan GCP Data Engineering
GCP Professional Data Engineer, re certified ,Exam experience and my suggestions to Aspirants
53:07
Selecting GCP ETL/Data processing services | GCP Professional Data Engineer
Anjan GCP Data Engineering
Selecting GCP ETL/Data processing services | GCP Professional Data Engineer
31:10
GCP Professional Data Engineer | Storage and Database selection process, Test your knowledge
Anjan GCP Data Engineering
GCP Professional Data Engineer | Storage and Database selection process, Test your knowledge
13:38
GCP Professional Data Engineer | Selecting suitable storage and database services based on use case
Anjan GCP Data Engineering
GCP Professional Data Engineer | Selecting suitable storage and database services based on use case
14:23
Cloud Big Table - Introduction | Console , CBT - Basic Demo with Examples
Anjan GCP Data Engineering
Cloud Big Table - Introduction | Console , CBT - Basic Demo with Examples
13:59
Import Bulk data from GCS into Spanner Table using Dataflow Jobs
Anjan GCP Data Engineering
Import Bulk data from GCS into Spanner Table using Dataflow Jobs
14:21
Basic Cloud Spanner database operations using Python Client Libraries
Anjan GCP Data Engineering
Basic Cloud Spanner database operations using Python Client Libraries
9:36
Cloud Spanner Introduction demo with examples
Anjan GCP Data Engineering
Cloud Spanner Introduction demo with examples
16:16
Automate Dataproc workloads using Cloud Composer
Anjan GCP Data Engineering
Automate Dataproc workloads using Cloud Composer
18:00
Composer - Airflow https operators, Extract data from web API using https operators with examples
Anjan GCP Data Engineering
Composer - Airflow https operators, Extract data from web API using https operators with examples
18:08
Thanks for your support !!! and More to come
Anjan GCP Data Engineering
Thanks for your support !!! and More to come
1:20
Schedule secured data load from Google sheets to Big query|Cloud Functions,Cloud Scheduler and more
Anjan GCP Data Engineering
Schedule secured data load from Google sheets to Big query|Cloud Functions,Cloud Scheduler and more
22:57
Big Query Clustered Tables with Examples
Anjan GCP Data Engineering
Big Query Clustered Tables with Examples
16:07
Big Query Table Partitions with Examples
Anjan GCP Data Engineering
Big Query Table Partitions with Examples
21:58
Google Cloud Storage Object Versioning and Auto Class
Anjan GCP Data Engineering
Google Cloud Storage Object Versioning and Auto Class
20:08
Schedule Dataproc Workflows using Cloud Scheduler
Anjan GCP Data Engineering
Schedule Dataproc Workflows using Cloud Scheduler
13:49
Cloud Scheduler Introduction with simple examples
Anjan GCP Data Engineering
Cloud Scheduler Introduction with simple examples
13:36
Export and Analyze GCP Billing data with BigQuery and Looker Studio
Anjan GCP Data Engineering
Export and Analyze GCP Billing data with BigQuery and Looker Studio
16:14
Google Cloud Storage (GCS) Object Lifecycle Management with Examples
Anjan GCP Data Engineering
Google Cloud Storage (GCS) Object Lifecycle Management with Examples
19:27
Dataproc Workflow Templates | Execute Jobs DAG on Managed Dataproc Cluster
Anjan GCP Data Engineering
Dataproc Workflow Templates | Execute Jobs DAG on Managed Dataproc Cluster
21:51
Big Query Routines , Stored Procedures and Anonymous Blocks for repeated tasks
Anjan GCP Data Engineering
Big Query Routines , Stored Procedures and Anonymous Blocks for repeated tasks
18:14
Big Query Federated queries | Connect and execute Cloud SQL queries from Big Query
Anjan GCP Data Engineering
Big Query Federated queries | Connect and execute Cloud SQL queries from Big Query
10:28
Cloud SQL Python connector | Access Cloud SQL Instance Programatically
Anjan GCP Data Engineering
Cloud SQL Python connector | Access Cloud SQL Instance Programatically
10:19
Running Dataflow Batch Jobs from Templates
Anjan GCP Data Engineering
Running Dataflow Batch Jobs from Templates
12:41
The Secret Manager in GCP to store and access sensitive data
Anjan GCP Data Engineering
The Secret Manager in GCP to store and access sensitive data
12:39
Import and Export data to and from Cloud SQL Instance
Anjan GCP Data Engineering
Import and Export data to and from Cloud SQL Instance
12:26
Running and Scheduling Dataflow Batch Pipelines (Dataflow Python Operator) with Composer
Anjan GCP Data Engineering
Running and Scheduling Dataflow Batch Pipelines (Dataflow Python Operator) with Composer
13:31
Connecting Cloud SQL from MySQL workbench
Anjan GCP Data Engineering
Connecting Cloud SQL from MySQL workbench
8:19
Big Query Quick data upload
Anjan GCP Data Engineering
Big Query Quick data upload
1:00
GCP Cloud SQL Introduction | Create MySQL Instance and connect it from Cloud Shell
Anjan GCP Data Engineering
GCP Cloud SQL Introduction | Create MySQL Instance and connect it from Cloud Shell
16:29
GCP Composer | Airflow GCS to BigQuery and BigQuery Operators
Anjan GCP Data Engineering
GCP Composer | Airflow GCS to BigQuery and BigQuery Operators
19:24
GCP Big Query Table function
Anjan GCP Data Engineering
GCP Big Query Table function
9:01
GCP Composer DAG code and deployment to DAGs folder | Python and Bash operator examples
Anjan GCP Data Engineering
GCP Composer DAG code and deployment to DAGs folder | Python and Bash operator examples
20:52
GCP Write curated logs to Big Query using PubSub events - Cloud Function combination
Anjan GCP Data Engineering
GCP Write curated logs to Big Query using PubSub events - Cloud Function combination
20:46
GCP Cloud Composer Introduction | Airflow managed service
Anjan GCP Data Engineering
GCP Cloud Composer Introduction | Airflow managed service
21:13
Update on code samples used in demos
Anjan GCP Data Engineering
Update on code samples used in demos
0:35
GCP Cloud Functions for Big query events | Extract data from big query table to GCS Bucket in CSV
Anjan GCP Data Engineering
GCP Cloud Functions for Big query events | Extract data from big query table to GCS Bucket in CSV
12:24
GCP Cloud Functions for GCS object events | Load data into Big Query tables against GCS events
Anjan GCP Data Engineering
GCP Cloud Functions for GCS object events | Load data into Big Query tables against GCS events
17:35
GCP Create and deploy Cloud Functions | Introduction
Anjan GCP Data Engineering
GCP Create and deploy Cloud Functions | Introduction
15:44
GCP Process Logs exported to GCS using Dataflow Batch Pipeline
Anjan GCP Data Engineering
GCP Process Logs exported to GCS using Dataflow Batch Pipeline
16:29
GCP Cloud Logging | Export logs to GCS , Big Query , PubSub for further Analysis or Process
Anjan GCP Data Engineering
GCP Cloud Logging | Export logs to GCS , Big Query , PubSub for further Analysis or Process
20:03
GCP Cloud Logging Introduction
Anjan GCP Data Engineering
GCP Cloud Logging Introduction
14:12
GCP Apache Beam Batch pipeline | Process nested , repeated data using Dataflow | write to Big Query
Anjan GCP Data Engineering
GCP Apache Beam Batch pipeline | Process nested , repeated data using Dataflow | write to Big Query
27:09
GCP Apache Beam stream data processing pipeline | Pub Sub , Dataflow , Big Query
Anjan GCP Data Engineering
GCP Apache Beam stream data processing pipeline | Pub Sub , Dataflow , Big Query
30:23
GCP Pub Sub | Python Client Libraries | Create Publisher , Subscriber Apps using Compute VM
Anjan GCP Data Engineering
GCP Pub Sub | Python Client Libraries | Create Publisher , Subscriber Apps using Compute VM
15:59
GCP Pub Sub Introduction | Create Topic , Subscription and publish messages , GCP console and CLI
Anjan GCP Data Engineering
GCP Pub Sub Introduction | Create Topic , Subscription and publish messages , GCP console and CLI
17:25
GCP Dataflow Apache Beam | Fixed windows , Sliding Windows , Session windows
Anjan GCP Data Engineering
GCP Dataflow Apache Beam | Fixed windows , Sliding Windows , Session windows
19:52
GCP Dataflow | Apache Beam | Side Inputs | Composite PTransforms
Anjan GCP Data Engineering
GCP Dataflow | Apache Beam | Side Inputs | Composite PTransforms
11:06
GCP Dataflow Apache Beam | Beam Transformations | Regex - match,find,split,replace | With timestamp
Anjan GCP Data Engineering
GCP Dataflow Apache Beam | Beam Transformations | Regex - match,find,split,replace | With timestamp
13:52
GCP Dataflow Apache Beam | Transformations | Combine,Count,Mean Globally,PerKey,Keys,Values,ToString
Anjan GCP Data Engineering
GCP Dataflow Apache Beam | Transformations | Combine,Count,Mean Globally,PerKey,Keys,Values,ToString
22:52
GCP Dataflow Apache Beam | Core Transformations| ParDo, Group,Flatten,Partition,Map,FlatMap
Anjan GCP Data Engineering
GCP Dataflow Apache Beam | Core Transformations| ParDo, Group,Flatten,Partition,Map,FlatMap
18:24
GCP Dataflow Apache Beam Notebooks | Create Beam Pipelines | Create PCollections | Examples
Anjan GCP Data Engineering
GCP Dataflow Apache Beam Notebooks | Create Beam Pipelines | Create PCollections | Examples
18:57
GCP Dataflow | Develop iterative Apache Beam pipeline using Jupiter Note book created from workbench
Anjan GCP Data Engineering
GCP Dataflow | Develop iterative Apache Beam pipeline using Jupiter Note book created from workbench
30:58
GCP Big Query table snapshots creation automation | Schedule script using service account
Anjan GCP Data Engineering
GCP Big Query table snapshots creation automation | Schedule script using service account
22:15
GCP Big Query access historical data using Time travel | Create Table snapshots
Anjan GCP Data Engineering
GCP Big Query access historical data using Time travel | Create Table snapshots
32:48
GCP Create Dataproc cluster with Jupyter Notebook installed | Run PySpark Jobs from Notebook
Anjan GCP Data Engineering
GCP Create Dataproc cluster with Jupyter Notebook installed | Run PySpark Jobs from Notebook
17:22
GCP Big Query | Query Public Datasets | Parameterized Queries | Wildcard Tables
Anjan GCP Data Engineering
GCP Big Query | Query Public Datasets | Parameterized Queries | Wildcard Tables
20:34
GCP Big Query Query data | Interactive and Batch Queries|Write Results | Save and Share Results
Anjan GCP Data Engineering
GCP Big Query Query data | Interactive and Batch Queries|Write Results | Save and Share Results
13:38
GCP Big Query Create and query External Tables |GCS files |Google Sheets
Anjan GCP Data Engineering
GCP Big Query Create and query External Tables |GCS files |Google Sheets
18:01
GCP Big Query Load JSON files , Nested and Repeated fields |STRUCT and ARRAY
Anjan GCP Data Engineering
GCP Big Query Load JSON files , Nested and Repeated fields |STRUCT and ARRAY
11:07
GCP Big Query Batch data loading | console, bq tool, Python API
Anjan GCP Data Engineering
GCP Big Query Batch data loading | console, bq tool, Python API
13:27
GCP Big Query ,Introduction, create datasets and tables using different options
Anjan GCP Data Engineering
GCP Big Query ,Introduction, create datasets and tables using different options
28:38
GCP Dataproc cluster Automation | Ephemeral Clusters
Anjan GCP Data Engineering
GCP Dataproc cluster Automation | Ephemeral Clusters
14:23
GCP Dataproc create cluster using CLI | Run PySpark job through GCP console
Anjan GCP Data Engineering
GCP Dataproc create cluster using CLI | Run PySpark job through GCP console
22:05
GCP - Dataproc ,PySpark - Shell , PySpark | Job Submit through Script
Anjan GCP Data Engineering
GCP - Dataproc ,PySpark - Shell , PySpark | Job Submit through Script
25:34
GCP Dataproc Cluster creation | HDFS and Hive
Anjan GCP Data Engineering
GCP Dataproc Cluster creation | HDFS and Hive
30:29
GCP - Dataflow - Submit jobs through SQL workspace and CLI
Anjan GCP Data Engineering
GCP - Dataflow - Submit jobs through SQL workspace and CLI
11:57
GCP - Dataflow - Apache Beam SQL
Anjan GCP Data Engineering
GCP - Dataflow - Apache Beam SQL
23:46
Big Query View Authorization
Anjan GCP Data Engineering
Big Query View Authorization
18:03
Big Query Editor Schedule SQL/Script
Anjan GCP Data Engineering
Big Query Editor Schedule SQL/Script
7:09
Big Query Data Transfer | Python API | Copy dataset
Anjan GCP Data Engineering
Big Query Data Transfer | Python API | Copy dataset
15:26
Big Query Data Transfer Service | GCS to Big Query data transfer
Anjan GCP Data Engineering
Big Query Data Transfer Service | GCS to Big Query data transfer
12:42
GCP Dataflow Streaming data processing demo
Anjan GCP Data Engineering
GCP Dataflow Streaming data processing demo
24:36
GCP Dataflow Batch data processing
Anjan GCP Data Engineering
GCP Dataflow Batch data processing
20:54