fix(deps): update module github.com/twmb/franz-go to v1.20.2 (main)

[renovate-sh-app]

This PR contains the following updates:

Package	Change	Age	Confidence
github.com/twmb/franz-go	v1.19.5 -> v1.20.2

---

Release Notes

twmb/franz-go (github.com/twmb/franz-go)

v1.20.2

Compare Source

===

This patch release fixes a field-access data race that has been around forever.
Specifically, if a partition was moving from one broker to another via a
metadata update at the same time a linger timer fired, there was a data race
reading a pointer that was being written. Most 64 bit systems don't experience
corruption with this type of race, so the code would execute fine but you may
have the old sink start draining when the new sink should have.

This also further improves some linger logic.

• 73c16c1d kgo: do not trigger draining early if a partition moves sinks while lingering
• d5066143 kgo: fix data race when the linger timer fires

v1.20.1

Compare Source

===

This small patchfix release fixes a longstanding bug in RequestCachedMetadata,
which became a problem now that kadm is using it by default: if no metadata was
cached and you requested all topics, no metadata request would be issued and
you'd get no valid response. Thank you @​countableSet
for the find and fix.

This also adds the two new 1.20 config options to OptValues, and a big doc
comment hinting to add new config opts going forward.

NOTE Follow up testing showed there are still more long-standing bugs with
RequestCachedMetadata. Usage of that function has been reverted from kadm
for the time being (which is, in the open source ecosystem, the only place this
function was ever used). All users of kadm v1.17.0 should bump to v1.17.1.

• 1087d3c7 kgo: add new opts to OptValues && big doc to do so going forward...
• cad283f0 bugfix kgo: fix for empty fetch mapped metadata (#​1143)

v1.20.0

Compare Source

===

This is a comparatively small minor release that adds support for Kafka 4.1,
adds three new APIs, fixes four bugs (read below to gauge importance), has a
few improvements, and switches the client from a default of 0ms linger to a
default of 10ms linger.

Also of note: a new srfake package has been created so you can run a fake
Schema Registry server in your CI tests (thank you @​weeco).
This complements the existing kfake package that allows you to run a fake
in-memory Kafka "cluster" for unit testing. If you did not know of either of these,
check them out! kfake supports many Kafka features, but transactions are still WIP.
All franz-go tests except transaction based tests pass against a kfake "cluster",
so odds are, it'll work for you.

There are a few external contributors this release to features, docs, bugs, and
internal improvements. If I do not call you out below directly, please know I'm
thankful for your contributions!

Behavior changes

• This library now lingers by default for 10ms. You can switch back to 0ms
  lingering by adding kgo.ProducerLinger(0) to your options
  when initializing the client. The original theory for 0ms linger was more of
  a theory, and years of practice has shown that even a tiny linger can be
  beneficial to the throughput and batching of clients.
  See #​1072 for more details.

Bug fixes

• Metadata refreshes could panic if a very specific flow of events happened,
  specifically only on a cluster that is transitioning from not using topic IDs
  to using topic IDs, and only if the transition is not implemented 100% correctly.
  This bug has existed for years and was only encountered during the recent addition
  of topic IDs to Redpanda. See 645f1126 for more details.

• The loop that determines whether more batches exist to be produced had its
  conditional backwards. This was hidden forever due to other minor logic flaws
  that caused the "do more batches exist?" check to occur more than it should
  have, so the bug caused no problems. The "do more batches exist?" checks have
  been improved and the conditional has been fixed.

• The internal linger timers fired way more than they needed to, causing
  batches to be cut WAY more frequently than they needed to when using
  lingering. The logic here has been fixed, so lingering should actually run
  its full time now and batches should be bigger.

• Azure resets connections when speaking ApiVersions v4. v1.19 of this library
  detected this resetting and after 3 attempts, downgrades to ApiVersions v3.
  However, the connection reset error is different when running on Windows.
  The code has been improved to detect the proper syscall when this library
  is running on Windows. Thanks @​axw!

Improvements

• Previously, producing was limited to 5 inflight requests per broker even if
  you disabled idempotence and bumped the number. The inflight limit is now
  unbounded. Thanks @​pracucci!

Features

• OnPartitionsCallbackBlocked now exists so that, if you are using
  BlockRebalanceOnPoll, you can be notified that a rebalance is desired. If
  your record processing function is slow, this allows you to interrupt your
  batch processing (if possible), wrap up committing, and allow a rebalance
  before your client is kicked from the group.

• ConsumeExcludeTopics, if you are using regex consuming, allows you to have
  a higher-priority set of regular expressions to exclude topics from being
  consumed. This is useful if you want to consume everything except a set of
  topics (for example, if you are replicating topics from one cluster to
  another). Thanks @​mmatczuk!

• Fetches.RecordsAll now exists to return a Go iterator for use in range loops.
  Thanks @​narqo!

Relevant commits

• 1844d216 feature kgo: add OnPartitionsCallbackBlocked
• 157580fd kgo.RequestSharded: support ConsumerGroupDescribe, ShareGroupDescribe
• f176953e behavior change kgo lingering: default to 10ms
• 679f7c3d kgo: add support for produce v13
• f7f61420 generate: new definitions for share requests
• 32997347 generate: new non-share protocols for kafka 4.1
• be947c20 bench: add -batch-recs, -psync, -pgoros
• 0b1dbf0c bugfix kgo: multiple linger fixes
• 2ea3251d bugfix sink: fix old bug determining whether more batches should be produced
• 195bed84 feature kgo: add ConsumeExcludeTopics
• 645f9d4b bugfix Check errno for (WSA)ECONNRESET
• 645f1126 bugfix kgo: fix panic in metadata updates from inconsistent broker state
• 612f26b6 feature kgo: add Fetches.RecordsAll to return a Go native iterator
• ce2bcd18 improvement kgo: use unlimited ring buffers in the Produce path, allowing >5 inflight requests

---

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

---

• If you want to rebase/retry this PR, check this box

---

Need help?

You can ask for more help in the following Slack channel: #proj-renovate-self-hosted. In that channel you can also find ADR and FAQ docs in the Resources section.