[FaZeTitans]

Summary

• Tests: Add 19 critical-path tests for transferCollection covering transforms with errors, conflict detection, batch commit failures, resume mode, subcollections + maxDepth, dry run, integrity verification, pagination, rate limiter, and skipped docs
• Error handling: Preserve partial stats on transfer error in orchestrator instead of returning empty stats
• Type safety: Add null to WhereFilter.value type, remove unsafe as unknown as casts in parser and webhook
• Code dedup: Remove duplicate clearOrphanSubcollections function, reuse clearDocSubcollections
• Dependencies: Bump all deps — eslint 10, yargs 18, firebase-tools 15, firebase-admin 13.7, prettier 3.8, typescript-eslint 8.56
• ESLint: Add @typescript-eslint/no-floating-promises rule, fix preserve-caught-error violations from ESLint 10
• CI/CD: Add security audit step, coverage reporting, tag/version verification in release workflow, fix bun test → bun run test

Test plan

• 578 unit tests pass (19 new)
• 27 integration tests pass (with Firestore emulator)
• Type check clean
• ESLint clean (with new rules)
• Prettier formatting clean
• CLI works with yargs 18 (fscopy --help)

[Copilot]

Pull request overview

This PR delivers a broad set of reliability, safety, and CI improvements for the Firestore copy tool, with emphasis on critical-path test coverage, safer config/type handling, and more resilient operational behavior (webhooks, state/resume, pagination).

Changes:

• Adds extensive unit + integration coverage for transferCollection, plus new integration test harness for the Firestore emulator.
• Refactors transfer/count/clear helpers for deduplication and performance (pagination, shared query/subcollection helpers), and improves state/resume + shutdown behavior.
• Tightens validation and safety (config bounds, transform file extension validation, webhook HTTPS-by-default with retry/size limits), and updates CI workflows + dependencies.

Reviewed changes

Copilot reviewed 54 out of 55 changed files in this pull request and generated 4 comments.

Show a summary per file

File	Description
src/webhook/index.ts	Adds webhook constants, payload sizing, retries, timeout, and HTTPS validation behavior updates.
src/utils/progress.ts	Adds ability to dynamically increase progress bar total.
src/utils/output.ts	Ensures log file parent directory exists before writing.
src/utils/index.ts	Re-exports FirebaseError type from errors utilities.
src/utils/errors.ts	Introduces FirebaseError interface and uses it for formatting/logging.
src/utils/credentials.ts	Routes credential-missing output to stderr via a single message write.
src/types.ts	Extends WhereFilter.value to include null; adds allowHttpWebhook to config/args.
src/transform/loader.ts	Validates transform file extensions; improves error chaining via cause.
src/transfer/transfer.ts	Refactors query/subcollection helpers; adds subcollection counting for progress; changes conflict detection; improves batch failure accounting; optimizes integrity verification logic.
src/transfer/index.ts	Exports new helper utilities (getFilteredSubcollections, buildQueryWithFilters).
src/transfer/helpers.ts	Adds shared getFilteredSubcollections + buildQueryWithFilters helpers.
src/transfer/count.ts	Refactors subcollection counting to paginate and reuse shared query helper.
src/transfer/clear.ts	Refactors clearing and orphan deletion to use pagination and shared subcollection filtering helper.
src/state/index.ts	Adds stderr warning helper; improves state loading diagnostics; adds resume validation warnings; changes validation return type.
src/orchestrator.ts	Preserves partial stats on failure; adds signal handling for graceful shutdown; adjusts progress-counting approach; threads new context state.
src/interactive.ts	Ensures Firebase app cleanup on interactive connection failures.
src/firebase/index.ts	Avoids credentials when using emulator; adds initialization guard; makes cleanup resilient; improves error chaining.
src/constants.ts	Adds bounds constants and webhook/clear constants (timeouts, payload size, paging size).
src/config/validator.ts	Adds numeric bounds validation and rename mapping validation (ID validity + collisions).
src/config/parser.ts	Adds config-extension warning; makes warnings go to stderr; removes unsafe casts; refactors merge logic via resolve().
src/config/defaults.ts	Adds allowHttpWebhook default.
src/cli.ts	Updates --limit description; adds --allow-http-webhook flag; passes allow-http into webhook validator.
src/tests/webhook.test.ts	Updates tests for new webhook URL validation behavior.
src/tests/validator.test.ts	Adds coverage for new config bounds validation + defaults updates.
src/tests/transfer.test.ts	Updates test config scaffolding for new config field.
src/tests/transfer-critical.test.ts	Adds critical-path transferCollection tests (new file).
src/tests/state.test.ts	Updates for new resume validation return type and warnings behavior.
src/tests/orchestrator.test.ts	Updates test config scaffolding for new config field.
src/tests/loader.test.ts	Adds tests for transform extension validation errors.
src/tests/interactive.test.ts	Updates test config scaffolding for new config field.
src/tests/integration/transfer.integration.test.ts	Adds Firestore-emulator integration tests for transfer behavior (new file).
src/tests/integration/helpers.ts	Adds emulator test helpers (app lifecycle, seed/query utilities, config/context creation) (new file).
src/tests/integration/end-to-end.integration.test.ts	Adds end-to-end integration tests for orchestrator pipeline (new file).
src/tests/integration/count.integration.test.ts	Adds integration tests for counting behavior (new file).
src/tests/integration/clear.integration.test.ts	Adds integration tests for clear + delete-missing behavior (new file).
src/tests/generator.test.ts	Adds tests for config generator behavior (new file).
src/tests/firebase.test.ts	Ensures Firebase cleanup between tests for deterministic initialization.
src/tests/display.test.ts	Adds tests for config/summary/json output formatting (new file).
src/tests/credentials.test.ts	Adds tests for credential path detection logic (new file).
src/tests/count.test.ts	Updates test config scaffolding and formatting cleanup.
src/tests/conflicts.test.ts	Updates test config scaffolding for new config field.
src/tests/clear.test.ts	Updates test config scaffolding for new config field.
package.json	Updates scripts (unit/integration split), adds emulator script, bumps dependencies/devDependencies.
firebase.json	Adds Firestore emulator configuration (new file).
examples/transforms/filter-and-reshape.ts	Adds example transform (filter/reshape) (new file).
examples/transforms/anonymize.ts	Adds example transform (anonymization) (new file).
examples/transforms/add-metadata.ts	Adds example transform (metadata injection) (new file).
eslint.config.js	Enables @typescript-eslint/no-floating-promises.
README.md	Documents new CLI flag and clarifies limit semantics; documents env vars and extension validation.
CLAUDE.md	Updates CLI option documentation table.
CHANGELOG.md	Adds initial changelog with release notes for 1.5.0 (new file).
.github/workflows/release.yml	Adds tag/version verification; fixes Bun test invocation.
.github/workflows/ci.yml	Adds audit/format/coverage steps and separate integration-test job.
.editorconfig	Adds repository-wide editor defaults (new file).

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.