scratchpad

Scratchpad for studying and exploration

Steps to run code/notebooks used in project.

• Install Docker from here

• Navigate to folder scratchpad.

  • To bring up the scratchpad container you may run either of below commands

    • if docker image is not build : you@yourmachine:~/somefolder/scratchpad$ make up_with_build
    • if image is already build : you@yourmachine:~/somefolder/scratchpad$ make up
    • when the container is up you can view the code/notebooks from below links
      • JupyterLab: http://localhost:9001/lab
      • CodeServer: http://localhost:8090/?folder=/scratchpad

  • To bring down a running scratchpad container run below command

    • you@yourmachine:~/somefolder/scratchpad$ make down

  • To fiddle with ray deployments run below command. (Note this needs to be run from inside the containers)

    • root@a0d72dc9f0e4:/scratchpad# python svcs/start_svc.py LLMServe

• Once the container launches you can create various environments using below commands

  • Install TGI environment once container starts

    • Navigate to location http://localhost:8090/?folder=/scratchpad
    • Open Teminal and run below command
      • root@22e5c9a5f35d:/scratchpad#chmod +x ./installers/install_tgi.sh && source ./installers/install_tgi

  • Install ray environment once container starts

    • Navigate to folder http://localhost:8090/?folder=/scratchpad
    • Open Teminal and run below command
      • root@22e5c9a5f35d:/scratchpad#chmod +x ./installers/create_ray_env.sh && source ./installers/create_ray_env.sh

MINIKUBE (WIP)

• Run a fastapi service on minikube.Note that its independent from scratchpad container
  • Install it from here
  • Navigate to folder you@yourmachine:~/somefolder/scratchpad/svcs/fastapi_kube_only/ and run below commands (run below different terminals and in sequence)
    • to deploy app : ~./deploykube.sh
    • to see minkube dashboard : ~./$minikube dashboard --url
    • to see service : ~./$minikube service kubefastapiapp --url