Production Health

Checks Stanford ExploreCourses CS140 page for Operating System content and response time under 5 seconds

Verifies kotlin.build website is operational: checks main page HTTP status, response time, logo reference, and logo image accessibility

Checks kotlin.directory landing page, logo.svg, and /api/list-artifacts endpoint

Checks that ExploreCourses latest file is within 24 hours and status is NORMAL

Checks URL Protocol P2P network: verifies at least 3 peers are online, hardware.control.fabric.daemon service is advertised, and simpledemo service is advertised

Verifies url://helloworld/ P2P service responds correctly to hello() and getNumber() via openSandboxedConnection

Verifies the url://simpledemo/ sandboxed service by connecting via P2P, downloading bytecode into SJVM sandbox, and running all 6 operations (add, multiply, factorial, concat, greet, fibonacci)

Verifies url://tasks/ service by creating, updating, reading, and deleting a task via P2P

Verifies kompile-cli build system: kotlin.directory accessibility, artifact resolution, and multi-version Kotlin compilation (default compiler + explicit 2.4.0 in an isolated compiler, verified via kotlin.Metadata metadataVersion)

Verifies the Docker Image Builder service is operational via openSandboxedConnection - tests connectivity, image listing, upload, build, and delete

Verifies url://dockerrun/ service is reachable and can start/list/terminate containers

Checks ContainerNursery health endpoint for healthy status, uptime, and container count

Connects to the production fabric daemon via mTLS, pings, gets status, and lists mesh hosts

Checks wasmserver.com homepage returns HTTP 200 with correct title

Checks wasmserver.com homepage

Checks todograph.wasmserver.com

Checks my.externalbrain.wasmserver.com

Checks getw3wallet.wasmserver.com

Checks getw3wallet.wasmserver.com

Checks getw3wallet.wasmserver.com

Checks productionhealth.wasmserver.com

Checks github-watchman-wui.wasmserver.com

Checks prdashboard.wasmserver.com

Checks buildtest.kotlin.build

Checks webcron.wasmserver.com

Checks lambdaserver.wasmserver.com

Checks that https://aiclisupervisor.wasmserver.com/ is reachable and returns the AiCliHostSupervisor WUI page

Checks that https://demo-url-http-frontend-proxy.wasmserver.com/ is reachable and returns successful RPC responses

Verifies FakeOpenAiServer (fake-openai.wasmserver.com) responds to Chat Completions API requests

Verifies FakeGeminiServer (fake-gemini.wasmserver.com) responds to generateContent API requests

Verifies FakeAnthropicServer (fake-anthropic.wasmserver.com) responds to Messages API requests

Verifies CivitDownloader service can download images from CivitAI with metadata via url://civitdownloader/

Checks that the Filedrop web UI at https://filedrop.wasmserver.com is operational - verifies /health endpoint and home page

Checks that the Blobstore service at url://blobstore/ is operational - verifies blob upload, download, listing, and pin/unpin operations

Verifies the Snipd Downloader WUI API is responding with valid episode metadata

Reports repositories whose scripts/build.bash or scripts/test.bash reference an out-of-date or deprecated kompile-cli coordinate

Detects orphan JVMs (PPID=1 reparented runners matching production-health-runner or remotejvm.local.agent.RemoteJvmAgent). Guards against regression of the parent-death watchdog shipped in remotejvm-local 0.0.10.

url://netlab-hosted/ manager health() returns OK (discovered via P2P mesh, no hard-coded IP)

url://netlab-hosted/ manager list() + exists() round-trip; read-only, never provisions a droplet

Submits a hello-world Kotlin app with one unit test to url://buildtest/ (submitBuild/getBuildRun/getTestResults) and verifies the build succeeds and the test passes. A full run (~4 min) outlasts the in-execution wait budget, so each execution verifies the previous execution's run and reports a previous run stuck >1h as an error.

End-to-end probe of url://searchable-bucket/: healthCheck, bucket create/delete, addDocument, full-text search round trip, and __bytecode_request client-JAR serving. Source: https://github.com/CodexCoder21Organization/SearchableBucketHealthCheck

Verifies url://cockroachdb/ by creating a probe account+database, running a SQL round trip through the vended sql.Database handle, and cleaning up

Verifies url://namecheap/ end-to-end against real Namecheap: reachability, isConnected (whitelisted egress), listDomains, and a self-cleaning DNS create/read/delete round-trip.

Reads a permanently-pinned multi-chunk canary blob (and optional production blob) back and verifies it still hashes to its content address; catches regressions that would make already-stored blobs unreadable.

Fails when the url://handoff/ to PlanRepository/handoffs/ mirror has not completed a successful reconcile for two hours (about 24 consecutive failed five-minute ticks). Reads url://handoff/gitSyncStatus. A quiet mirror with nothing to publish stays healthy; a single failed tick is only a warning.

Fails when the url://handoff/ to PlanRepository/handoffs/ mirror has not completed a successful reconcile for two hours (about 24 consecutive failed five-minute ticks). Reads url://handoff/gitSyncStatus. A quiet mirror with nothing to publish stays healthy; a single failed tick is only a warning.

Fails when the url://handoff/ to PlanRepository/handoffs/ mirror has not completed a successful reconcile for two hours (about 24 consecutive failed five-minute ticks). Reads url://handoff/gitSyncStatus. A quiet mirror with nothing to publish stays healthy; a single failed tick is only a warning.

Fails when the url://handoff/ to PlanRepository/handoffs/ mirror has not completed a successful reconcile for two hours (about 24 consecutive failed five-minute ticks). Reads url://handoff/gitSyncStatus. A quiet mirror with nothing to publish stays healthy; a single failed tick is only a warning.