N-Notebook Repo N-Glass Repo N-Optics Repo GCP Logs Sentry Logs Splunk Logs

Namespaces

 
Lens

 
 lens = "Optics" 
 lens-cbioportal = "Cbioportal"
 lens-glass= "Glass"
 lens-notebooks = "Notebook"

Severities

 
 severity=INFO 
 severity=ERROR
 severity=WARNING
 severity=DEBUG

Notebook Logs (#GCP)

 
Basic Query

 
 resource.type="k8s_container"
 resource.labels.namespace_name="lens-notebooks"
 severity=ERROR
 
 
 
Pod Specific

 
Hub : -

 resource.type="k8s_container"
 resource.labels.namespace_name="lens-notebooks"
 severity=ERROR
 resource.labels.pod_name="hub-98f55df4c-6pxhd"

User Pod :-

resource.type="k8s_container"
resource.labels.namespace_name="lens-notebooks"
severity=ERROR
resource.labels.pod_name="jupyter-kartik-2edesai-40tempus-2ecom"

Optics Logs (#GCP) 

 
Basic Query

 
 resource.type="k8s_container"
 resource.labels.namespace_name="lens"
 severity=ERROR
 

 
Search Using Message

 
 resource.type="k8s_container"
 resource.labels.namespace_name="lens"
 severity=ERROR
 jsonPayload.message="Error handling request"
 
 

 
Search Using Traceback

 
 resource.type="k8s_container" 
 resource.labels.namespace_name="lens" 
 labels."k8s-pod/tempuslabs_com/service"="optics"
 resource.labels.cluster_name="prd-env-cluster"
 (jsonPayload.traceback=~"No Inbound Link exists for Outbound Link")
 
 
 optics db-migration

 
resource.labels.pod_name=~"optics-db-migrate"
resource.type="k8s_container"
resource.labels.cluster_name="alp-env-cluster"

For Specific Pod :- 

resource.labels.pod_name=~"optics-db-migrate"
resource.type="k8s_container"
resource.labels.cluster_name="bet-env-cluster"
resource.labels.pod_name="optics-db-migrate-2677f391-sns5x"

Splunk Logs

 
Basic Query

 
    index="gcp-app" | search "gcpMetadata.resource.labels.cluster_name"="alp-env-cluster" "gcpMetadata.labels.k8s-pod/app_kubernetes_io/component"=optics | search "cBio"

Kubectl Cheat Sheet

 
Set Up Kubectl

 Tech Handbook
 
 
Kuberbetes Namespaces 


 Namespaces are Kubernetes objects which partition a single Kubernetes cluster into multiple virtual clusters.
 
 Get All Namespaces - kubectl get namespace
 Get Current Namespace - kubectl config view --minify | grep namespace:
 Set Namespace - kubectl config set-context --current --namespace=
 E.g kubectl config set-context --current --namespace=lens-notebooks
 
 
 
Kuberbetes Pod 


 Are the smallest deployable units of computing that you can create and manage in Kubernetes.
 
Get All Pods in the current namespace -  kubectl get pods
Get All Pods in all namespaces -  kubectl get pods --all-namespaces
Go inside a specific running pod  -  kubectl exec -it podName  -- bash
E.g  kubectl exec -it jupyter-kartik-2edesai-40tempus-2ecom -- bash 
 
 
Kuberbetes Logs 


 
General Logs = Kubectl logs podname
For Live Logs = Kubectl logs -f podname  
e.g (See Single Notebook pod live logs)
kubectl logs -f jupyter-kartik-2edesai-40tempus-2ecom