RisingWave Releases

release v3.0.3 What's Changed perf(stream): apply LRU watermark to over-window partition cache at chunk boundaries ( #26424 ) by @risingwave-ci in #26436 fix(meta): exclude internal tables from time travel epoch mappings ( #26443 ) by @risingwave-ci in #26447 fix(sink): persist empty pre-commit epochs ( #26498 ) by @yuhao-su in #26507 fix(frontend): decouple Iceberg Engine schema change from compaction by @chenzl25 in #26545 cherry-pick fix(meta): reconcile stale serving vnode mappings ( #26352 ) to release-3.0 by @rw-jarvis-bot[bot] in #26369 fix(batch): cap masked fragment mapping parallelism ( #26560 ) by @risingwave-ci in #26570 fix(iceberg): bump dependencies on release-3.0 by @chenzl25 in #26628 cherry-pick feat(connector): ADLS Gen2 service-principal auth for Iceberg sink ( #26124 ) to release-3.0 by @chenzl25 in #26633 fix(iceberg): bump dependencies for operator caching on release-3.0 by @chenzl25 in #26634 fix(sink): throttle coordinator recovery retries on release-3.0 by @chenzl25 in #26639 cherry-pick fix(stream): keep consuming on a no-op sink config update ( #26484 ) to release-3.0 by @yuhao-su in #26661 chore: update version to v3.0.3 by @cyliu0 in #26686 Full Changelog : v3.0.2...v3.0.3

release v3.0.2

release v3.0.1

release v2.8.5

What's Changed fix(ci): check future milestone in bump main workflow by @cyliu0 in #24685 chore(deps): Bump sysinfo from 0.37.2 to 0.38.0 by @dependabot [bot] in #24600 refactor: use strong typed id in system catalog and strong typed UserId by @wenym1 in #24677 chore: move cursor rules to AGENTS.md by @BugenZhao in #24709 refactor(grafana): improve cluster alerts by @kwannoel in #24518 feat: support downloading gcloud-cli for both Linux and macOS by @Standing-Man in #24512 chore(deps): Bump bytes from 1.11.0 to 1.11.1 by @dependabot [bot] in #24699 test(meta): enhance validation of drop object tests by @Standing-Man in #24665 refactor: strong typed hummock id by @wenym1 in #24689 feat: support table functions for datafusion by @silver-ymz in #24715 feat: Add Kafka consumer lag catalog and monitoring tests by @tabVersion in #24708 fix(snapshot-backfill): fix deadlock caused by next_epoch by @wenym1 in #24693 feat(optimizer): improve locality backfill for agg by @chenzl25 in #24710 fix(iceberg): clear iceberg compaction meta data when dropping iceberg sink by @chenzl25 in #24730 feat: support show cursors and subscription cursors for all frontend nodes by @Standing-Man in #24107 feat(frontend): support enable_serverless_backfill by @chenzl25 in #24686 feat: add metrics for datafusion engine by @silver-ymz in #24707 feat: support DROP SECRET CASCADE by @Standing-Man in #24581 feat: enhance oom handling for datafusion by @silver-ymz in #24736 feat(frontend): support equivalent batch orders for eq-prefix scans by @chenzl25 in #24729 feat: support caching object dependencies info in frontend by @yezizp2012 in #24706 chore(frontend): support FATAL message by @yezizp2012 in #24704 refactor(types): make StructType debug output concise by @BugenZhao in #24651 fix: disallow duplicate CTE names within the same WITH clause by @Standing-Man in #24676 feat(prost): support strong typed map value type by @wenym1 in #24695 chore(deps): Bump tempfile from 3.24.0 to 3.25.0 by @dependabot [bot] in #24759 feat(frontend): allow users to confirm if background_ddl is enabled for a sink by @Standing-Man in #24338 fix(meta): fix compaction group merge scheduling efficiency by @Li0k in #24757 chore: add agent skill fix-buildkite-ci by @BugenZhao in #24752 chore: Replace unmaintained rustls-pemfile with rustls-pki-types by @Copilot in #24712 refactor(source): skip bad file splits after retry in fs_fetch executor by @wcy-fdu in #24718 refactor: update some metric level by @zwang28 in #24750 fix: panic when DataFusionPlanConverter fails by @silver-ymz in #24766 feat: support LogicalExpand in DataFusion by @silver-ymz in #24767 feat(cdc): support postgres 18 by @wcy-fdu in #24765 feat(cdc): add RW_JAVA_LOG to control Java connector logging granularity by @wcy-fdu in #24404 feat(source): add Parquet case-insensitive column matching option for file source by @wcy-fdu in #24734 refactor(cdc): add configurable total timeout for CDC schema history putObject by @wcy-fdu in #24749 feat: risectl command to force change Source Connector Props by @tabVersion in #24392 fix(cdc): excluded generated column from postgres publication validation by @wcy-fdu in #24380 fix(frontend): wait for notification version on WAIT command by @wenym1 in #24768 fix: update heartbeat to include CPU and memory resource information for consistency by @yezizp2012 in #24781 Bound default adaptive parallelism to 64 by @kwannoel in #24678 feat(refill): support meta cache refill concurrency limit by @MrCroxx in #24787 feat(observability): add fragment-level immutable memtable memory metrics by @EdwinaZhu in #24620 ci: add on-demand ec2 docker image workflow by @Li0k in #24797 feat: add a config to control whether state table vnode prunning is enabled by @hzxa21 in #24703 feat(observability): add memory profiling for log store buffer by @EdwinaZhu in #24688 feat: add metrics for cross database consuming epoch by @qccash in #24802 feat: add RescheduleIntent command and resolve in barrier worker by @shanicky in #24670 refactor: improve compaction schedule by @Li0k in #24733 fix(udf): use forked ginepro to avoid leaking background LB probe task by @BugenZhao in #24705 chore(deps): Bump org.assertj:assertj-core from 3.27.4 to 3.27.7 in /java by @dependabot [bot] in #24601 chore: add gemini review bot config by @yuhao-su in #24820 feat(pgwire): support setting session params via StartupMessage::options by @xiangjinwu in #24754 chore(deps): Bump enum-as-inner from 0.6.0 to 0.7.0 by @dependabot [bot] in #24680 chore(deps): Bump async-openai from 0.32.3 to 0.33.0 by @dependabot [bot] in #24822 chore(deps): Bump uuid from 1.19.0 to 1.20.0 by @dependabot [bot] in #24599 test: fix integration test by @tabVersion in #24816 feat(config): Increase max storage memory proportion by @maingoh in #24644 chore(deps): Bump aws-lc-rs from 1.15.3 to 1.16.0 by @dependabot [bot] in #24823 feat(optimizer): support mv selection for batch queries by @chenzl25 in #24611 feat(optimizer): support prunning for mv selection by @chenzl25 in #24751 feat(license): maintain rwu limit check for single-node deployments by @hzxa21 in #24796 feat: add support to alter backfill parallelism for streaming jobs by @shanicky in #24323 chore: clarify generated alter-on-fly update path by @tabVersion in #24847 fix(meta): narrow reschedule blocking for creating backfill jobs by @shanicky in #24798 feat(sink): support alter jdbc sink url , username and password by @xxhZs in #24846 fix: subtract overflow when passing empty array to array_positions by @silver-ymz in #24860 chore(deps): Bump toml from 0.9.11+spec-1.1.0 to 1.0.3+spec-1.1.0 by @dependabot [bot] in #24830 feat: mapping datafusion array functions by @silver-ymz in #24859 feat(connector): add configurable write-parquet-properties for Iceberg sink and compaction by @Copilot in #24612 fix(stream): cap staged watermarks per upstream to prevent unbounded memory growth by @yuhao-su in #24856 fix(mysql-cdc): fix MySQL CDC auto schema change for UNSIGNED integer types by @wcy-fdu in #24855 fix(optimizer): move locality enforcement to logical_rewrite_for_stream by @chenzl25 in #24850 chore(dashboard): bump node.js version to 16 by @yuhao-su in #24819 fix(iceberg): fix staging pk in iceberg refreshable table by @chenzl25 in #24872 fix(iceberg): upgrade iceberg dependencies by @chenzl25 in #24873 fix: support jdbc sink alter-on-fly fields by @tabVersion in #24861 chore: align datafusion spill dir with risingwave config by @silver-ymz in #24877 refactor(meta): introduce partial graph manager and extract common logic by @wenym1 in #24428 fix(iceberg): fix flaky test t-refresh-composite-pk by @chenzl25 in #24888 fix(storage): fix last_serde for NonPkPrefixSkipWatermarkState and ValueSkipWatermarkState by @zwang28 in #24890 fix: update broken documentation URLs by @lmatz in #24897 feat(sink): add keeplive with option for pg rust sink and jdbc sink by @xxhZs in #24388 feat: reserve memory headroom for unspillable DataFusion operators by @silver-ymz in #24883 feat(subscription): support altering retention of subscription by @wenym1 in #24842 fix(storage): fix iter_with_prefix_respecting_watermark for NonPkPrefix by @zwang28 in #24909 fix(meta): fence drop vs split updates and skip stale fragment splits by @tabVersion in #24887 feat: show sink's target table in system table and describe statement by @Standing-Man in #24893 feat: add ca option for schema registry by @tabVersion in #17826 UPD: add fn has_schema_usage_privilege to allow schema owner has USAGE privilege on the schema by @qccash in #24692 refactor(hummock): unify level normalization for table-id mutations by @Li0k in #24896 refactor(meta): apply command in inflght state in one step by @wenym1 in #24906 fix(frontend): preserve join shape in consecutive join separation by @yezizp2012 in #24925 test: fix flaky rate limit source test by @tabVersion in #24931 feat(optimizer): agg mv selection by @chenzl25 in #24782 fix(optimizer): fix full outer join null filter by @chenzl25 in #24899 feat(pg-cdc): monitor upstream max lsn and more accurate lsn lag by @wcy-fdu in #24919 chore: bump tonic and prost to 0.14 by @BugenZhao in #24727 feat(risedev): allow multiple levels in manual compaction trigger by @yuhao-su in #24843 feat: enable clippy lints for stack overflow detection & fix warnings by @faketygg in #24939 fix(storage): fix iter_with_prefix_respecting_watermark for nonpkprefix by @zwang28 in #24950 chore: recommend user to use locality backfill by @hzxa21 in #24784 feat(frontend): support locality backfill in rw_fragment_backfill_progress by @yezizp2012 in #24955 fix(source): try fix flaky e2e source test by @wenym1 in #24953 feat(tracing): support RW_TRACING_EXTRA_ATTRIBUTES env var by @cyberchen98 in #24946 chore(deps): Bump the opentelemetry group across 1 directory with 2 updates by @faketygg in #24956 fix(test): reset adaptive parallelism strategy in log store simulation tests by @wenym1 in #24959 refactor(common): DRY between DataTypeToAst and data_type_to_ast_data_type by @xiangjinwu in #24975 revert(stream): parallelize apply_chunk in agg by @lmatz in #24988 fix: correct the use of clean_watermark_index in iter_with_prefix_respecting_watermark by @yuhao-su in #24828 test: harden kafka-sasl alter connection e2e against broker-2 startup race by @hzxa21 in #24981 refactor(meta): deprecate is_unschedulable for worker by @wenym1 in #25003 chore: improve PR template by @Standing-Man in #24669 feat(expr): implement crc32 and crc32c bytea functions by @faketygg in #24964 feat(iceberg): bump iceberg-rust to 20260303 by @chenzl25 in #24949 feat(optimizer): improve locality support for topn and overwindow by @chenzl25 in #24994 chore(deps): bump forked avro from 0.16.0 to 0.21.0 by @xiangjinwu in #25009 fix(meta): use fallback_service to replace nest_service for axum router by @cyliu0 in #25011 test: stabilize non-shared source connector props flaky assertion by @tabVersion in #24997 feat(iceberg): support rw_iceberg_compaction_schedules by @chenzl25 in #25013 chore(deps): migrate hyper from 0.14 to 1 as much as possible by @BugenZhao in #24655 refactor(hummock): add owned from_persisted_protobuf to reduce memory amplification by @Li0k in #24940 feat: support watermark ttl for cdc table by @BugenZhao in #24992 chore(deps): Bump time from 0.3.36 to 0.3.47 by @dependabot [bot] in #24722 chore(deps): Bump http-body from 0.4.6 to 1.0.1 by @dependabot [bot] in #25031 feat(meta): reject registeration of workers in different RW_VERSION by @wenym1 in #25019 chore(deps): bump arrow used by adbc from 56 to 57 by @xiangjinwu in #25034 feat(iceberg): dump rw iceberg compaction schedules to diagnosis by @chenzl25 in #25015 chore(deps): Bump gcp-bigquery-client from 0.27.0 to 0.28.0 by @dependabot [bot] in #16547 chore(deps): Bump const-str from 1.0.0 to 1.1.0 by @dependabot [bot] in #24683 chore(deps): Bump aws-lc-fips-sys from 0.13.9 to 0.13.12 by @dependabot [bot] in #24945 chore(deps): Bump ipnet from 2.11.0 to 2.12.0 by @dependabot [bot] in #24944 refactor(meta): split source split assignment into discovery and resolution phases by @wenym1 in #24924 fix(stream): skip empty chunks in synced kv log store to prevent seq_id progress assertion failure by @wenym1 in #25037 fix(meta): commit transaction after aborting subscription creation by @Li0k in #25041 feat: vnode key range info by @Li0k in #24176 refactor(meta): improve the determinism of trigger_manual_compaction by @zwang28 in #25017 chore(deps): Bump mongodb from 3.2.5 to 3.5.1 by @dependabot [bot] in #25028 chore(deps): Bump pulsar from 6.3.0 to 6.3.1 by @dependabot [bot] in #25027 refactor(meta): remove vnode-aligned level size threshold by @Li0k in #25047 refactor(meta): extract shared actor alignment and edge-building logic for new fragments by @wenym1 in #25039 feat(meta): add compression and part-read for hummock version checkpoint by @Li0k in #24937 chore: refine storage related grafana metrics by @hzxa21 in #24739 fix(stream): sync ops with visibility after noop elimination in HashDataDispatcher by @jw-itq in #24968 feat(streaming): improve watermark handling for hash join by @yuhao-su in #24144 fix(cdc): fix compatibility issues with SQL Server CDC table name by @wcy-fdu in #25057 fix(iceberg): disable iceberg row selection by @chenzl25 in #25060 feat(iceberg): support iceberg sink commit checkpoint size threshold mb by @chenzl25 in #25058 feat(sql): add BACKUP and delete meta snapshot commands by @yezizp2012 in #25042 chore(deps): Bump clap from 4.5.1 to 4.5.60 by @dependabot [bot] in #25072 test: decouple inject skip coverage from mysql cdc reset test by @tabVersion in #25016 chore(deps): Bump pulsar from 6.3.1 to 6.7.1 by @dependabot [bot] in #25064 chore(deps): Bump lz4_flex from 0.11.1 to 0.11.6 by @dependabot [bot] in #25085 chore(deps): Bump quinn-proto from 0.11.11 to 0.11.14 by @dependabot [bot] in #25053 chore(deps): Bump lz4_flex from 0.12.0 to 0.12.1 by @xiangjinwu in #25087 feat(observability): track channel buffered memory by @EdwinaZhu in #24810 refactor(meta): render actor in global barrier worker for create/replace job by @wenym1 in #24984 fix(binder): support schema-qualified names on BindContext by @Standing-Man in #24628 feat: support pool_setup_concurreny for gRPC client by @zwang28 in #25098 fix(mysql-cdc): tolerate 2-column SHOW BINARY LOGS results by @qccash in #25101 fix(meta): skip no-op reschedules before actor allocation by @shanicky in #25081 fix(test): fix meta snapshot tests by @zwang28 in #25118 refactor(frontend): include user name in query log by @zwang28 in #25102 feat(frontend): add iceberg engine storage selection by @silver-ymz in #25043 feat: support atomically adding column for iceberg table by @yezizp2012 in #24756 refactor(meta): store table change log independently by @zwang28 in #24252 refactor(common): cleanup redundant ToSql by @xiangjinwu in #25132 chore(deps): Bump aws-lc-fips-sys from 0.13.12 to 0.13.13 by @dependabot [bot] in #25137 feat(common): add Bounded/Ratio parallelism config types by @shanicky in #25125 fix(source): drop stale wait checkpoint task by @zwang28 in #25152 fix(sqlserver): fix sqlserver data type mismatch issue by @wcy-fdu in #25131 feat(meta): support wait jobs by @chenzl25 in #25133 feat(sqlserver-cdc): add consume offset monitor and lag monitor by @wcy-fdu in #25124 chore(deps): Bump authlib from 1.6.5 to 1.6.9 in /e2e_test by @dependabot [bot] in #25082 refactor(meta): unify epoch node management of partial graphs by @wenym1 in #25123 fix(frontend): apply session timezone rewrite to watermark expressions by @chenzl25 in #25175 chore: reject zero max prefetch block number by @hzxa21 in #25179 fix(risedev): bump maven version to 3.9.14 by @EdwinaZhu in #25185 fix(binder): resolve columns only within visible relation context by @Standing-Man in #25107 chore(deps): Bump the strum group with 2 updates by @dependabot [bot] in #24839 fix: preallocate compaction task id range per loop and assert bounds by @Li0k in #24654 fix(iceberg): Reject dots in database.name for Iceberg sink by @Copilot in #24630 refactor(frontend): unify session config parallelism and frontend resolution by @shanicky in #25126 feat: meta generalize compaction-group normalize with batched split deltas by @Li0k in #24852 chore(dashboard): remove vulnerable unused dependency from frontend package by @Copilot in #25194 fix(binder): handle generated column validation for INSERT with/without column list by @Standing-Man in #25187 fix(sink): fix redshift sink intermediate_schema name set by @xxhZs in #24947 chore: default enable datafusion engine for batch query by @silver-ymz in #25198 chore(deps): Bump hyper from 1.6.0 to 1.8.1 by @dependabot [bot] in #25030 refactor(ci): deduplicate CI test scripts and fix shell safety bugs by @tabVersion in #25209 feat(iceberg): add Iceberg source ingestion metrics by @chenzl25 in #25122 fix(sqlparser): adapt to winnow 1.0 Stream API changes by @TennyZhuang in #25213 fix(monitor): add compression and use larger decode limit for MonitorService by @yuhao-su in #25208 feat(stream): make join_cache_evict_interval_rows configurable by @chenzl25 in #25210 chore(deps): Bump hyper from 1.8.1 to 1.9.0 by @dependabot [bot] in #25216 refactor(meta): unify barrier item collection for partial graphs and finishing jobs by @wenym1 in #25219 feat(object-store): support limit the opendal req concurrency by @wenym1 in #25222 fix(meta): load fragment parallelism from meta store table directly by @wenym1 in #25220 feat(source): adaptive splits + streaming pull for PubSub source by @tabVersion in #25074 fix: iceberg e2e test when default to use datafusion by @silver-ymz in #25215 feat(sink): support limiting the max concurrent initializing kv log store reader by @wenym1 in #25224 refactor(meta): unify barrier completion flow to partial-graph manager by @wenym1 in #25157 fix(metric): fix several grafana panels by @zwang28 in #25232 fix(batch): fix batch asof join by @chenzl25 in #25223 fix(sink): fix file sink name conflict issue by @wcy-fdu in #25241 fix(sink): handle postgres upsert when all columns are primary keys by @hzxa21 in #25253 fix(source): eliminate checkpoint-path network I/O and add ack failure metrics by @tabVersion in #25144 ci: run pubsub emulator via docker by @tabVersion in #25238 feat(streaming): state clean for eowc over window numbering functions by @yuhao-su in #24477 chore(deps): Bump arc-swap from 1.8.0 to 1.9.1 by @dependabot [bot] in #25259 chore: change file sink log level to avoid noise by @wcy-fdu in #25262 fix(dashboard): use topk(1) for kube resource limits in relative CPU/memory queries by @arkbriar in #25257 refactor(meta): extract independent ckpt job enum by @wenym1 in #25249 fix(cdc): fix CDC false-ready handshake by setting Debezium Connected only after real streaming connection by @wcy-fdu in #25245 feat(meta): add database_info metric for database id to name mapping by @arkbriar in #25231 feat(agents): add RisingWave rust-analyzer skill by @tabVersion in #25268 refactor(meta): decouple serving fragment mapping notification from streaming fragment mapping by @wenym1 in #25263 chore(deps): Bump datafusion from 52.2.0 to 52.4.0 by @dependabot [bot] in #25162 fix(risedev): make generate-example-config work in worktrees by @Li0k in #25244 fix(sink): truncate barriers in batching log sink during idle periods by @wcy-fdu in #25276 fix: ignore stale refresh finish events after source drop by @tabVersion in #25272 fix(binder): adjust the position of default columns by @Standing-Man in #25196 ci: replace personal token with GitHub App token for doc issue creation by @lmatz in #25293 feat(frontend): support secret references as function call arguments by @tabVersion in #25212 feat(streaming): add materialize vnode key stats config by @hzxa21 in #25290 chore(deps): Bump lodash from 4.17.23 to 4.18.1 in /dashboard by @dependabot [bot] in #25264 fix(frontend): track secret deps for views and sinks by @tabVersion in #25291 fix(iceberg): ban iceberg source with pk by @chenzl25 in #25295 fix: iceberg source type mismatch by @silver-ymz in #25316 Revise README for event streaming branding and resources by @yingjunwu in #25318 build: set maven compiler versions from 11 to 17 by @xiangjinwu in #25294 chore: retain barrier complete logs per database by @hzxa21 in #25225 feat(expr): support wildcard parameter in jsonb_agg by @Copilot in #25282 chore(doc): Clarify primary storage terminology in README by @yingjunwu in #25324 chore: Revise use cases and design decisions in README by @yingjunwu in #25326 chore: Refactor use cases in README.md for clarity by @yingjunwu in #25329 chore: clean unused code by @silver-ymz in #25335 refactor: split src/connector/src/sink/iceberg/mod.rs to multiple files by @silver-ymz in #25337 fix(cdc): allow SQL Server tables with multiple CDC capture instances by @wcy-fdu in #25317 fix(common): [BREAK] Hash for jsonbb::StringRef shall be same as &str by @xiangjinwu in #25345 fix(cdc): use shared state to prevent concurrent schema history corruption by @wcy-fdu in #25269 feat(meta): run compaction group normalize before merge only by @Li0k in #25334 feat(frontend): expose schema names in system catalogs by @xxhZs in #25248 refactor: switching to rw-fork madsim by @tabVersion in #25351 refactor(source): remove unused code by @zwang28 in #25363 fix(frontend): reject internal tables in subscription and MV DDL by @tabVersion in #25338 refactor(ci): split connector e2e source and sink tests by @wenym1 in #25270 feat(source): add source reader progress events by @tabVersion in #25258 feat(stream): allow snapshot backfill executor without upstream merge by @wenym1 in #25250 fix(storage): filter compact table ids in compactor by @Li0k in #25381 fix(sink): fix bigquery sink auto_create by @xxhZs in #23837 feat(iceberg): support order key by @xxhZs in #25202 fix(meta): fix time travel vacuum by @zwang28 in #25402 fix(connector): drain kafka enumerator events during meta split discovery by @tabVersion in #25405 feat(sink): add HTTP sink by @wenym1 in #25396 feat(optimizer): support mv selection for inner join by @chenzl25 in #25046 chore(deps): Bump next from 16.2.1 to 16.2.3 in /dashboard by @dependabot [bot] in #25322 chore(e2e): upgrade Spark to 4.0.2 and Iceberg to 1.10.1 for e2e tests by @yuhao-su in #25172 chore(deps): Bump github.com/jackc/pgx/v5 from 5.5.4 to 5.9.0 in /integration_tests/client-library/go by @dependabot [bot] in #25393 chore(iceberg): bump iceberg chain to fb290e4c/a9ce53cc by @Li0k in #25366 chore(deps): Bump protobufjs from 7.2.6 to 7.5.5 in /dashboard by @dependabot [bot] in #25395 feat(cdc): support ALTER SOURCE CONNECTOR for cdc password by @wcy-fdu in #25435 fix(ci): avoid duplicate nexmark Kafka rows by @wenym1 in #25437 fix(sink): ensure barrier progress must be truncated on log store by @wenym1 in #25440 chore(ci): improve backward compat test by @yuhao-su in #25429 fix(ci): exclude pubsub from pre-start dev by @Standing-Man in #25408 feat(frontend): support iceberg V3 sink with PK index on frontend by @silver-ymz in #25346 feat(sink): support exactly-once Delta Lake sink by @wenym1 in #25159 fix(dml): wait for persistence before completing fast insert in dml executor by @wenym1 in #25441 feat(stream): add no-cache path for AsOf join by @yuhao-su in #25218 chore(deps): Bump org.eclipse.jetty:jetty-http from 12.0.24 to 12.0.33 in /java by @dependabot [bot] in #25354 fix(sqlsmith): fix fuzz test cleanup to handle server-side MV creation after client timeout by @lmatz in #25379 chore: bump protobuf in integration test by @yuhao-su in #25433 test: add slt test for tracking alter sink config feature by @Standing-Man in #25005 fix(sink): update kv log store value indices after schema change by @wenym1 in #25442 feat(cdc): support ingest upstream pg vector type by @wcy-fdu in #25184 feat(pg-cdc): support convert upstream composite type into text by @wcy-fdu in #25153 chore(deps): bump arrow-udf-runtime to 0.9.0 and remove tonic 0.12 by @yuhao-su in #25461 ci(pubsub): avoid custom image by @xiangjinwu in #25265 fix(cdc): avoid aborting auto schema change on non-constant default expressions by @wcy-fdu in #25431 feat(meta): track iceberg compaction with commit backlog by @Li0k in #25283 refactor(cdc): remove unnecessary date converter by @xiangjinwu in #25289 refactor(cdc): drop is_bigserial_default special case by @wcy-fdu in #25474 chore(deps): bump openssl to 0.10.78 to fix high-severity advisories by @yuhao-su in #25468 chore(deps): Bump org.bouncycastle:bcpkix-jdk18on from 1.79 to 1.84 in /java/connector-node/risingwave-sink-jdbc by @dependabot [bot] in #25392 chore(deps): Bump org.bouncycastle:bcprov-jdk18on from 1.78 to 1.84 in /java/connector-node/risingwave-sink-jdbc by @dependabot [bot] in #25407 fix(meta): avoid panic when dropping initial job by @wenym1 in #25481 chore(deps): Bump uuid from 11.0.5 to 14.0.0 in /dashboard by @dependabot [bot] in #25462 fix(iceberg): support using dot in iceberg namespace by @chenzl25 in #25475 fix(meta): clean dropped streaming jobs outside post collect by @wenym1 in #25480 feat(frontend): support TLS for webhook endpoint and multi-column webhook tables by @wenym1 in #25443 fix: add SHOW PROCESSLIST hint to distributed query limit error message by @mailtoboggavarapu-coder in #25428 feat(connector): support protobuf encoding for MQTT source by @Standing-Man in #25403 feat(frontend): add WebSocket ingest with async acks by @wenym1 in #25444 chore: bump java version from 17 to 21 by @yuhao-su in #25497 chore(deps): Bump org.apache.hive:hive-metastore from 4.1.0 to 4.2.0 in /java by @dependabot [bot] in #23934 chore(deps): upgrade deltalake and align arrow by @Li0k in #25479 chore: add lazy PR label guidance for agents by @tabVersion in #25532 refactor(source): disable maxwell, canal and citus-cdc by @xiangjinwu in #25534 feat(session): allow unitless statement_timeout to mean ms by @xiangjinwu in #25557 chore(deps): Bump parse-display from 0.10.0 to 0.11.0 by @dependabot [bot] in #25560 chore(deps): Bump async-openai from 0.33.0 to 0.36.1 by @dependabot [bot] in #25513 chore(deps): Bump bitflags from 2.10.0 to 2.11.1 by @dependabot [bot] in #25353 fix(meta): sync source secret deps on alter connection by @tabVersion in #25582 refactor(storage): normalize compact task table ids by @Li0k in #25438 fix(meta): sync inflight stream node rate_limit on Throttle command by @yuhao-su in #25562 refactor: replace #[allow] with #[expect] across the codebase by @wenym1 in #25519 refactor(cdc): larger default snapshot.interval for cdc backfill by @wcy-fdu in #25577 fix(pgwire): make JWK alg optional and pin verification to an allow-list by @xuhui-lu in #25453 fix(binder): refine error message for ambiguous columns by @Standing-Man in #25546 fix(meta): cleanup dirty recovery hummock tables by @Li0k in #25592 feat(streaming): decouple synced log store progress from downstream backpressure by @EdwinaZhu in #24303 fix(iceberg): revert 25058 by @chenzl25 in #25614 fix(frontend): wait checkpoint for implicit dml flush by @wenym1 in #25518 chore(deps): bump openssl to 0.10.79 by @yuhao-su in #25615 chore(deps): Bump next from 16.2.3 to 16.2.6 in /dashboard by @dependabot [bot] in #25616 fix(stream): restore committed watermark by natural value by @yuhao-su in #25547 fix(optimizer): fix split now or rule by @chenzl25 in #25626 fix(jvm): exit compute node on embedded JVM OutOfMemoryError by @wcy-fdu in #25625 fix(optimizer): fix expand operator for distinct agg by @chenzl25 in #25623 chore(deps): Bump async-openai from 0.36.1 to 0.38.1 by @dependabot [bot] in #25618 chore(deps): Bump async-nats from 0.46.0 to 0.47.0 by @dependabot [bot] in #25227 chore(deps): Bump hashbrown from 0.16.1 to 0.17.1 by @dependabot [bot] in #25621 chore: update actions/checkout from v4 to v5 by @Copilot in #25579 fix(meta): skip missing drop jobs in barrier worker by @wenym1 in #25634 feat(risedev): add local messaging and deltalake flows by @xxhZs in #25432 fix(sqlserver-cdc): tolerate ill-formed UTF-16 in nvarchar/ntext payloads by @wcy-fdu in #25596 fix: unify and simplify streaming parallelism configuration by @shanicky in #25050 fix(meta): clean up compaction group metrics by @Li0k in #25553 feat(stream): change sink default parallelism to bounded 8 by @chenzl25 in #25660 fix(meta): keep failed foreground DDL tables fetchable by @wenym1 in #25647 fix(grafana): stop labeling streaming tables as mviews by @lmatz in #25670 fix(iceberg): prevent stuck state on empty tasks in fetch executor by @ericnoam in #25538 fix(frontend): harden SHOW object visibility by @tabVersion in #25585 fix(optimizer): normalize arithmetic rank predicates for over-window … by @murphylee10 in #25608 feat: disable bloom filter for kv log store tables by @hzxa21 in #25180 feat(expr): support array overlap predicates by @wenym1 in #25597 chore(docs): clarify adaptive parallelism migration note by @hzxa21 in #25661 feat(connector): expose Pulsar source operation retry controls by @tabVersion in #25467 feat(optimizer): support column pruning for expand by @chenzl25 in #25648 feat(frontend): support ALTER WATERMARK for live tables by @yuhao-su in #25651 feat(frontend): keep sync log store node at fragment root ( #25663 ) by @risingwave-ci in #25694 fix(meta): skip recovered pending sink epochs ( #25690 ) by @risingwave-ci in #25696 fix(frontend): disable unused prefix bloom hints ( #25672 ) by @risingwave-ci in #25698 feat(iceberg): default snapshot expiration ( #25700 ) by @risingwave-ci in #25701 fix(frontend): handle avg over empty window frame ( #25675 ) by @risingwave-ci in #25688 ci: fix main-cron sink and opendal failures ( #25695 ) by @risingwave-ci in #25707 refactor(storage): reuse block meta keys in xor filter reader ( #25706 ) by @risingwave-ci in #25709 feat(connector): allow altering Kafka SSL configs on the fly ( #25717 ) by @risingwave-ci in #25722 feat(frontend): log SQL for extended protocol ( #25702 ) by @risingwave-ci in #25712 fix(iceberg): revert snapshot expiration defaults ( #25723 ) by @risingwave-ci in #25726 ci: wait for elasticsearch health in sink test ( #25720 ) by @risingwave-ci in #25734 ci: add autoupdate rebase workflow ( #25685 ) by @risingwave-ci in #25730 fix(iceberg): seperate iceberg snapshot expiration and compaction trigger ( #25749 ) by @risingwave-ci in #25753 chore(release): bump version to v3.0.0-rc.1 by @cyliu0 in #25754 fix(source): default NATS ack policy to explicit ( #25705 ) by @risingwave-ci in #25777 fix(connector): suppress expected kafka enumerator UnknownGroup ( #25704 ) by @risingwave-ci in #25770 fix(iceberg): fix iceberg glue iam assume role token expiration ( #25776 ) by @risingwave-ci in #25796 chore: bump iceberg deps for token refresh by @xxhZs in #25814 fix(iceberg): avoid shared default AWS credentials provider in Iceberg sink ( #25829 ) by @risingwave-ci in #25841 fix(pg-cdc): make composite-to-string schema unconditionally optional ( #25815 ) by @risingwave-ci in #25820 fix(pgwire): parse StartupMessage with empty value at end correctly ( #25803 ) by @risingwave-ci in #25839 cherry-pick fix(iceberg): support reading uuid/fixed columns as bytea ( #25807 ) to release-3.0 by @yuhao-su in #25852 fix(sink): add trailing slash to snowflake pipe stage path ( #25851 ) by @risingwave-ci in #25866 feat(pg-cdc): support TOAST unchanged-value placeholder for vector columns ( #25863 ) by @risingwave-ci in #25874 feat(sink): support dynamic URL for HTTP sink ( #25699 ) by @risingwave-ci in #25896 fix(ci): skip stale SST compat test for fixed versions ( #25769 ) by @risingwave-ci in #25771 refactor(cdc): revert 9a6ab33 by @zwang28 in #25910 cherry-pick fix(iceberg): protect compaction snapshots from GC in release-3.0 by @Copilot in #25902 chore: update version to v3.0.0 by @cyliu0 in #25938 New Contributors @maingoh made their first contribution in #24644 @faketygg made their first contribution in #24939 @jw-itq made their first contribution in #24968 @mailtoboggavarapu-coder made their first contribution in #25428 @xuhui-lu made their first contribution in #25453 @ericnoam made their first contribution in #25538 @murphylee10 made their first contribution in #25608 Full Changelog : v2.8.0...v3.0.0

release v3.0.0-rc.1

release v2.8.4

release v2.8.3

release v2.7.4

release v2.8.2