Skip to content

firebase documentation#170

Merged
rugeli merged 11 commits into
mainfrom
doc/firebase-new
May 1, 2026
Merged

firebase documentation#170
rugeli merged 11 commits into
mainfrom
doc/firebase-new

Conversation

@rugeli
Copy link
Copy Markdown
Contributor

@rugeli rugeli commented Jan 7, 2026

Problem

What is the problem this work solves, including
closes #105

we've been wanting to document our Firebase schema for a while, this pr introduces the first version.

Solution

What I/we did to solve this problem

  • added database schema, collection overview, access and permission notes, general usage, etc

Type of change

Please delete options that are not relevant.

  • New feature (non-breaking change which adds functionality)

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Jan 7, 2026

Coverage Report

Status Category Percentage Covered / Total
🔵 Lines 32.5% 677 / 2083
🔵 Statements 32.5% 677 / 2083
🔵 Functions 39.42% 41 / 104
🔵 Branches 73.3% 151 / 206
File CoverageNo changed files found.
Generated in workflow #269

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Jan 7, 2026

PR Preview Action v1.8.1
Preview removed because the pull request was closed.
2026-05-01 17:30 UTC

@rugeli rugeli marked this pull request as draft January 20, 2026 17:49
@rugeli
Copy link
Copy Markdown
Contributor Author

rugeli commented Apr 27, 2026

04/27/2026 schema update:

  • removed recipes_edited row
  • rewrote overview and cleanup note to match the server and frontend update

@rugeli rugeli requested review from ascibisz, Copilot and meganrm April 27, 2026 18:48
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds initial Firebase/Firestore documentation to the cellPACK client repo to make the database schema and client usage easier to understand (per #105).

Changes:

  • Link Firebase documentation from the main README.
  • Add a Firebase overview section to CONTRIBUTING.md (collections used + access notes).
  • Introduce FIREBASE_SCHEMA.md describing Firestore collections and retention/cleanup policies.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 5 comments.

File Description
README.md Adds a “cellPACK Database” section linking to the new Firebase docs.
CONTRIBUTING.md Adds “Firebase Overview”, collection access summary, and access guidance.
FIREBASE_SCHEMA.md New schema document describing Firestore collections, fields, and cleanup policies.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread FIREBASE_SCHEMA.md Outdated
Comment thread FIREBASE_SCHEMA.md
Comment thread FIREBASE_SCHEMA.md Outdated
Comment thread CONTRIBUTING.md Outdated
Comment thread CONTRIBUTING.md Outdated
@rugeli rugeli marked this pull request as ready for review April 28, 2026 21:11
Comment thread README.md Outdated
* GET /logs?logStreamName={name}
* GET /packing-status?jobId={id}
* **Batch**: A call to POST /submit-packing launches a new batch job to run. A call to GET /packing-status will return the status of the specified batch job. Once the job is completed, the path to the results file(s) will be added to the results table of the cellPACK Firebase database.
* **Batch**: A call to POST /submit-packing launches a new batch job to run. A call to GET /packing-status will return the status of the specified batch job. Once the job is completed, the path to the results file(s) is written to the job's `job_status` entry in the cellPACK Firebase database.
Copy link
Copy Markdown
Contributor

@ascibisz ascibisz Apr 29, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We aren't using **Batch** anymore, we should change this to **ECS**

We also don't use the GET /packing-status endpoint anymore, so we can probably remove all references to that

Comment thread README.md Outdated
* **Batch**: A call to POST /submit-packing launches a new batch job to run. A call to GET /packing-status will return the status of the specified batch job. Once the job is completed, the path to the results file(s) is written to the job's `job_status` entry in the cellPACK Firebase database.
* **S3**: Result files from the AWS Batch job are written to the `cellpack-demo` S3 bucket.
* **ECR**: Docker image built from the [cellPACK github repo](https://github.com/mesoscope/cellpack) is published to the `cellpack-private` ECR repository. That image defines the container specificationsin which the batch job will run.
* **CloudWatch**: Logs from each AWS Batch job are written to CloudWatch. These logs can be accessed via the GET /logs endpoint.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We actually have several references to Batch here that are out of date, now might be the time to remove all of those?

We do still have the concept of "jobs" for each packing in ECS, so we can probalby replace "AWS Batch job" with "AWS packing job" in most places. I think this cloudwatch line can be removed all together, we don't post logs there anymore

@rugeli rugeli merged commit eca9c1c into main May 1, 2026
2 checks passed
@rugeli rugeli deleted the doc/firebase-new branch May 1, 2026 17:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add Firebase Documentation

4 participants