Skip to main content

Associate cloud Engineer notes

 google cloud offers below services: 

  • compute 
  • storage
  • big data 
  • machine learning 
  • application services
at the end of this notes you will be able to : 
  • identify the value of the google cloud products 
  • use application deployment environment on google cloud
  • use google storage options 
  • interact with google cloud service
  • describe the ways in which customers use google cloud .  
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>.
TOPICS: 
cloud computing 
IAAS ,PAAS,SAAS
pricing and billing
google cloud hierarchy 
IAM
VPC 
compute engine
scaling virtual machines through load balancer
cloud DNS and CDN 
google cloud storage options 
storage classes and data transfer 
cloud SQL 
cloud spanner 
Firestore
Bigtable 
comparing storage options 
containers in cloud 
kubernetes 
google kubernetes engine 
hybrid and multi cloud 
Anthos 
App Engine 
cloud run 
development in cloud 
deployment : insfrastructure as code 
automating the deployment using the terraform.
monitoring 
measuring the performance and reliability 
integrated observability tools
monitoring tools 
logging tools


>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>...

cloud computing : 
  • customers get on demand service 
  • customers gets access to those service from anywhere.
  • provider of those resources allocates them to users out of that pool 
  • resources are elastic and flexible
  • customers only pay for what they use 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

Google cloud network :
it is designed to achieve the :
  • highest possible throughput
  • lowest latency 
  • 100 plus content caching nodes worldwide 
  • high demand content is cached for quiker access. 
google cloud infrastructure is based on 5 major geographic locations:
  • north america 
  • south america 
  • europe 
  • asia 
  • australia
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>..
latency : 
it measures the time a packet of information takes to travel from its source to destination. 

location is divided into regions and regions are divided into availability zones . 

EX: Europe > london> (region: europe-west2)> europe-west2-a, europe-west2-b

>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>.

Google cloud and AWS comparison : 
FeaturesGoogle CloudAmazon Web Services
Offered ByGoogleAmazon
Computing ServiceGoogle Compute Engine API (IaaS), App Engine (PaaS), Kubernetes Engine (Container), Cloud Functions (Serverless Functions)Amazon Elastic Compute Cloud (IaaS), Elastic Beanstalk(PaaS), Elastic Compute Cloud Container Service (Container), AWS Lambda (Serverless Functions)
Database ServicesGoogle Cloud SQL (RDBMS), Google Cloud Datastore, Google Cloud Bigtable (NoSQL Key–Value), Google Cloud Datastore (NoSQL: Indexed)Amazon Relational Database Service (RDBMS), Amazon DynamoDB (NoSQL Key–Value), Amazon SimpleDB (NoSQL Indexed)
Storage ServicesGoogle Cloud Storage (Object Storage), Google Compute Engine Persistent Disks (Block Storage), ZFS/Avere (File Storage), Google Cloud Storage Nearline (Cold Storage)Amazon Simple Storage Service (Object Storage), Amazon Elastic Block Store (Block Storage), Amazon Elastic File System (File Storage), Amazon Glacier (Cold Storage)
Management ServicesStackdriver Monitoring (Monitoring), Google Cloud Deployment Manager (Deployment)Amazon CloudWatch (Monitoring), AWS CloudFormation (Deployment)
Network ServicesVirtual Private Cloud, Google Cloud Load Balancing, Google Cloud Interconnect, Google Cloud DNSAmazon Virtual Private Cloud, Elastic Load Balancer, Direct Connect, Amazon Route 53
Customization of instancesGoogle Cloud Platform provides a wide range of customization for any InstanceAWS provides limited customization.
PricingGoogle charges per minute basisAmazon charges per hour basis
CostGoogle free tiers have no time limit. GCP provides $300 worth credit that can be used across all services. Hence, GCP is comparatively cheaper.Amazon free tiers have a maximum validity of 12 months and later charges as per usage. Hence, AWS is costlier.
DowntimeGCP had reported more downtime compared to AWSAWS had reported lesser downtime compared to GCP which makes it a clear winner in this case
Big data supportBig data analysis tool is AI FirstBig data analysis tool is AWS Lambda.
AI/ML SupportCloud Machine Learning Engine, Dialogflow Enterprise Edition, Cloud Natural Language, Cloud Speech API, Cloud Translation API, Cloud Video Intelligence, Cloud Job DiscoveryTools offered by AWS for AI/ML are SageMaker, Comprehend, Lex, Polly, Rekognition, Machine Learning, Translate, Transcribe, DeepLens, Deep Learning AMIs, Apache MXNet, TensorFlow
AvailabilityGCP is available in 29 geographic regions and 88 zones worldwideAWS is available at 26 geographic regions and 84 zones worldwide
Companies usingSpotify, HSBC, Home Depot, Snapchat, Philips, Coca Cola, Domino’s and many moreNetflix, Twitch, LinkedIn, Facebook, ESPN, Citrix, Expedia and many more


>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>..

cloud computing service models  : 


IAAS : Amazon EC2 , google compute engine. 
PAAS : google app engine, cloud run , Amazon elastic beanstalk 
SAAS: google gmail , google drive , one drive . 


>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>..

pricing at google cloud : 
  • per second billing
  • running an compute engine instance for more than 25 percent of the month gives you the discount for every incremental minute you use for that instance. 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>..
how can I make sure I dont accidently run up a big google cloud bill ? 

  • we can set our budget . 
  • we can create an alert
  • we can check reports in GCP 
  • GCP offers quotas , which avoids over consumption of the resources

>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
Projects in google cloud : 

  • projects are separate entities in google cloud .
  • project holds resources ,each of which belongs to one project . 
  • project can have different owners and users . 
  • projects are billed and managed separately.
Each google cloud project has 3 attributes : 
project id 
project name 
project number

>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>.
Google cloud organization heirarchy : 

organisation node 
            |
       folder
           |
       project           
           |
     resources
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>.
IAM : 
  • who has access to what should be defined so IAM comes into existence here. 
  • administrators can apply policies that define who can do what and on which resources. 
  • who can be : google account ,google group ,service account , cloud identity domain. 
  • what can be : role
  • role : collection of the permissions. you grant a role to someone, you grant the collection of permissions to someone. 
IAM roles : 

  • basic IAM role : contiains owner, editor, viewer, billing admin
    • if several people are working together on the project that contains the sensitive data, basic roles are probably too broad. 
  • predefined role: 
    • if you want someone only to have an access to virtual machines. we can give him instance admin role which contains the following permission :
    • get instances , delete instances , start instances ,stop instance etc.
  • custom IAM role : you want someone to have permission to start and stop the instance , but not configure them. in that case we can create the custom IAM role. like : instance operator who will have permissions like : 
    • get instances , list instances, start instances , stop instances, and will not have the permission to configure the instances like changing the memory of the instance. 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

what if you want to give the permissions to virtual machine and not the person ?

you have applicaiton running on the virtual machine that is storing the data in     cloud storage, but you dont want anyone on the internet to have access to that data. you can create service account to authenticate that VM to cloud storage. 

>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

How to access the google cloud ? 
  • google cloud console 
  • cloud sdk and cloud shell 
  • APIs
  • cloud mobile app

SDK : 
  • set of tools to manage the resources and applications hosted on the google cloud. 
  • gcloud tool: provides the main CLI to access the google cloud services . 
  • gsutil : provide the access to cloud storage from the command line.
  • bq : command line tool for big queery
  • cloud shell : provides cli from browser to access the resources. 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>.

VPC: secure , individual ,private cloud computiing model hosted in the public cloud where customers can run code, store data , hosts websites ,and anything else that can be done in an ordinary private cloud. it is hosted remotely by public cloud provider . 

use : 
  • connects google cloud resources to each other and to the internet. 
  • segmenting the networks 
  • using firewall rules to restrict the access to instances .
  • creating the static route to forward traffic to specific destinations 
  • VPC networks are global and can have the subnets in any google cloud region. 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>....
Google compute engine : 

  • can create and run virtual machines on google infrastructure. 
  • each vm contains the power and functionality of a full fledged operating system. 
  • can be configured much like the physical server .
  • can be created using the CLI , google cloud console , or compute engine API. 
  • can run windows server images and linux images, or any customised images. 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

google cloud storage products : 

  • cloud storage
  • cloud SQL 
  • cloud spanner 
  • firestore
  • cloud bigtable
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>.

Cloud Storage : 
  • offers durable and highly available object storage ,its not a file or the block storage. 
  • allow customer to store any amount of data. 
  • fully managed scalable service that has a wide variety of users. 
  • its a binary large object storage 
  • online content can be saved 
  • can be used for backup and archiving 
  • storage of intermediate results 
  • objects are stored into buckets. 
  • objects in bucket are immutable. which means if you update the object new version is created for that object . original object is not changed . 
  • cloud storage offers lifecycle policies: ex : delete the objects older than 365 days. or create the objects created before particular date. or keep only the 3 most recent versions.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>.
storage classes in cloud storage : 
  • standard storage:
    • best for frequently accessed data. 
  • nearline storage : 
    • best for infrequently accessed data. once per month
  • coldline storage : 
    • best for the data which is accessed once per quarter. 
  • archive storage : 
    • best for the data which is accessed once per year. 




















Comments

Popular posts from this blog

Linux basic commands

 Linux basic commands: du  -sh  *  |  sort  -h  -r   |  head  -n  40  :    list out first 40 files in the directory that are taking more space in the directory.  cd : change directory Is-l listing the items in long listing format  pwd : print working directory Is-I format: type :no of links:owner : group:size :month :day :time :name cd/: go to/directory whoami: tells us by which username we are logged in. touch jerry: creates the file named jerry in present working directory. cp jerry lex: copy the content of jerry file and paste it to lex file. vi text1: creates the file text1 and open it in vi editor mkdir superman: creates the directory called superman mkdir abc def  : creates 2 folder in one command. touch filename wont work in /etc/ folder if logged in by normal account. man cp: shows manual for cp command. echo "india is my country"> file1 puts the text in file1. rm filename: remove the filename  mv lex luther renames the file from lex to luther  mv luther /h

patching tasks

 Patching a Linux system is a critical task to ensure that the system remains secure, stable, and up-to-date with the latest features and fixes. Here’s a comprehensive guide to the tasks involved in Linux patching: 1. Pre-Patching Preparation Backup System : Ensure you have a full system backup, including critical data, configuration files, and applications. Test the backup to verify its integrity. Check Disk Space : Verify that you have enough disk space, particularly on /var , /tmp , and /boot partitions. Review Current Patch Level : Determine the current patch level and installed packages using package management tools like yum , apt , dpkg , or rpm . Check System Logs : Review system logs to identify any issues that might affect the patching process. Test in a Staging Environment : If possible, apply patches in a staging environment that mirrors production to identify potential issues. Notify Stakeholders : Inform stakeholders about the scheduled maintenance window and expected do