Scene interpreter (#156)

* execution toggle

* deploy scenes.json

* bootstrap rendering interpreted scenes

* some clarity

* gradient

* e2e tests for both scene types

* data gradient

* values

* app exports

* tag'em

* works with a gradient

* app loader basics

* app loaders

* some basic json interpretation

* more snap changes

* log faster

* less lazy

* python 3.12

* seq fields

* field nodes

* all apps

* fix color defaults

* more working

* state and scene nodes

* state works

* basic caching

* actually evaluate some js

* add submodule

* subs

* deploy quickjs

* add noise

* inline burrito instead

* search for scenes

* nix deploys work

* this works

* js types

* remove global vars

* float plus code node args

* better script

* render as a function

* cleanup

* slight touchup

* undef

* dataNewImage

* split loop

* all scens

* no full redeploy if interpreted

* ts fix

* upgrade pillow

* build with quickjs

* split in two

* chjanges

* refresh repos

* enough for the xkcd scene

* dispatch

* image url

* use the latest quickjs

* textarea focus scroll

* split js runtime

* fix

* tz

* tz fix

* code node log output frontend

* log code node outputs

* a bit of frontend cleanup

* disable a bunch of logging

* less noise

* Revert "use the latest quickjs"

This reverts commit 4d6e3ec.

* misc cleanup

* take out the trash

* scene nodes work in all directions

* type fix

* fix color input

* use bg color for scene nodes

* show saved and unsaved states

* better differ

* fix panel bug

* parseJson

* js

* js scene state

* remove modules

* misc cleanup

* fix

Author: mariusandra

.github/workflows/docker-publish-multi.yml

@@ -15,7 +15,7 @@ jobs:
       - name: Set up Python
         uses: actions/setup-python@v2
         with:
-          python-version: '3.11'
+          python-version: '3.12'
 
       - name: Set up Node
         uses: actions/setup-node@v2

.github/workflows/e2e-docker.yml

@@ -12,6 +12,8 @@ jobs:
     steps:
       - name: Check out repository
         uses: actions/checkout@v3
+        with:
+          submodules: true  # Fetch submodules
 
       - name: Build Docker image
         run: |

.github/workflows/pull-request-tests.yml

@@ -17,7 +17,7 @@ jobs:
       - name: Set up Python
         uses: actions/setup-python@v2
         with:
-          python-version: '3.11'
+          python-version: '3.12'
 
       - name: Cache pip packages
         uses: actions/cache@v4
@@ -38,11 +38,17 @@ jobs:
         with:
           repo-token: ${{ secrets.GITHUB_TOKEN }}
 
-      - name: FrameOS nim tests
+      - name: FrameOS nim build
         run: |
           cd frameos
           nimble install -d
           nimble setup
+          FRAMEOS_ROOT_DIR="." python3 ../e2e/makeapploaders.py
+          nimble build
+
+      - name: FrameOS nim tests
+        run: |
+          cd frameos
           nimble test
   
       - name: Visual regression tests
@@ -71,7 +77,7 @@ jobs:
       - name: Set up Python
         uses: actions/setup-python@v2
         with:
-          python-version: '3.11'
+          python-version: '3.12'
 
       - name: Install redis
         run: sudo apt-get install -y redis-server

.gitignore

@@ -35,6 +35,7 @@ dist-ssr
 # Nim
 frameos/tmp/
 e2e/tmp/
+e2e/frameos/
 
 gpt.txt
 .env

CONTRIBUTING.md

@@ -4,7 +4,7 @@
 ## Prerequisites
 
 You'll need to install:
-Python >= 3.11
+Python >= 3.12
 `Node.js` and `npm`
 `redis-server`
 `nim >=2.0.0` (https://nim-lang.org/install.html)

Dockerfile

@@ -1,5 +1,5 @@
-# Use the official Python 3.11 image as the base
-FROM python:3.11-slim-bullseye
+# Use the official Python 3.12 image as the base
+FROM python:3.12-slim-bullseye
 
 # Set the working directory
 WORKDIR /app

backend/app/api/repositories.py

@@ -1,4 +1,6 @@
 import logging
+import asyncio
+from datetime import datetime, timedelta
 from http import HTTPStatus
 from fastapi import Depends, HTTPException
 from sqlalchemy.exc import SQLAlchemyError
@@ -71,6 +73,13 @@ async def get_repositories(db: Session = Depends(get_db)):
             db.commit()
 
         repositories = db.query(Repository).all()
+
+        for r in repositories:
+            # if haven't refreshed in a day
+            if not r.last_updated_at or r.last_updated_at < datetime.utcnow() - timedelta(seconds=86400):
+                # schedule updates in the background
+                asyncio.create_task(r.update_templates())
+
         return [r.to_dict() for r in repositories]
     except SQLAlchemyError as e:
         logging.error(f'Database error: {e}')