OONI Probe CLI v3.21.0-alpha

This is an alpha release for creating a branching point for the release/3.21 branch.

Please see release 3.21.0 for an explanatory changelog.

This build lacks linux/armv6 binaries because of ooni/probe#2694.

What's Changed

• chore: we're now hacking on v3.21.0-alpha by @bassosimone in #1439
• chore(deps): bump golang.org/x/crypto from 0.16.0 to 0.17.0 by @dependabot in #1441
• feat(oohelperd): protect against overload and add metrics by @bassosimone in #1442
• chore(deps): bump github.com/cloudflare/circl from 1.3.6 to 1.3.7 by @dependabot in #1443
• fix(dnsping): make output more actionable by @bassosimone in #1444
• fix(libtor): prevent concurrent instances by @bassosimone in #1445
• refactor(webconnectivitylte): make analysis flags public by @bassosimone in #1447
• refactor(minipipeline): allow avoiding linear analysis by @bassosimone in #1448
• feat(minipipeline): add DNSLookupSuccessWithBogonAddresses by @bassosimone in #1449
• chore(minipipeline): increase code coverage by @bassosimone in #1450
• feat(minipipeline): add ControlFinalResponseExpectations by @bassosimone in #1451
• feat(minipipeline): add ControlFinalResponseExpectations (2/2) by @bassosimone in #1452
• feat(minipipeline): add DNS and HTTP unexplained failures by @bassosimone in #1453
• feat(webconnectivitylte): classic computes XBlockingFlags by @bassosimone in #1446
• feat(webconnectivitylte): classic supports XNullNullFlags by @bassosimone in #1454
• cleanup(webconnectivitylte): remove the orig engine by @bassosimone in #1455
• cleanup(webconnectivitytle): avoid code duplication by @bassosimone in #1456
• feat(webconnectivitylte): handle ghost DNS censorship by @bassosimone in #1457
• feat(webconnectivitylte): add more tests and comments by @bassosimone in #1458
• minipipeline: fix expected TCP & TLS failures by @bassosimone in #1459
• fix(webconnectivitylte): make IDNA WAI by @bassosimone in #1460
• chore(minipipeline): add test case for ooni/probe#2456 by @bassosimone in #1461
• fix(oohelperd): make sure endpoints don't connect to 127.0.0.1 by @bassosimone in #1463
• fix(oohelperd,netemx): construct equivalent HTTPTransports by @bassosimone in #1464
• cleanup(netxlite): remove first-order implicit-Netx wrappers by @bassosimone in #1465
• refactor(oohelperd): depend on netxlite.Netx only by @bassosimone in #1466
• refactor(oohelperd,netmx): reduce construction diff to zero by @bassosimone in #1467
• refactor(netemx,oohelperd): use oohelperd.NewHandler constructor by @bassosimone in #1468
• chore(minipipeline): regenerate test cases by @bassosimone in #1469
• fix(webconnectivitylte): handle measurements with loopback addrs by @bassosimone in #1462
• chore(minipipeline): add http://firefox.com test case by @bassosimone in #1470
• chore(minipipeline): add data to understand ooni/probe#1511 by @bassosimone in #1471
• fix(minipipeline): handle IP-addr URLs in classic linear analysis by @bassosimone in #1472
• fix(webconnectivitylte): handle domains w/o A/AAAA records by @bassosimone in #1473
• chore: use latest zlib version published (1.3.1) by @ainghazal in #1477
• doc(Readme.md): add link to miniooni by @bassosimone in #1478
• feat(webconnectivitylte): add Cloudflare CAPTCHA test cases by @bassosimone in #1476
• chore(webconnectivityqa): reproduce ooni/probe#2628 issue by @bassosimone in #1479
• fix(webconnectivitylte): handle malformed redirect URLs by @bassosimone in #1480
• minipipeline: fix computing HTTPResponseBodyIsTruncated by @bassosimone in #1481
• chore(webconnectivitylte): add large file test cases by @bassosimone in #1475
• chore(buildtool): support go1.18+ by @bassosimone in #1483
• feat(buildtool): add the gofixpath subcommand by @bassosimone in #1484
• feat(buildtool): introduce script/go.bash wrapper by @bassosimone in #1485
• feat(Makefile): use ./script/go.bash by @bassosimone in #1482
• doc(Readme.md): mention ./script/go.bash by @bassosimone in #1486
• fix(script/go.bash): support Ubuntu 22.04 LTS and Debian 11 by @bassosimone in #1487
• fix(webconnectivitylte): count bytes sent and received by @bassosimone in #1488
• feat(engineresolver): add wikimedia DNS by @bassosimone in #1489
• BREAKING CHANGE: feat: move StreamAllContext to netxlite by @bassosimone in #1490
• cleanup(all): remove the run experiment by @bassosimone in #1492
• refactor(all): improve SummaryKeys management by @bassosimone in #1491
• feat(webconnectivitylte): wire-in SummaryKeys by @bassosimone in #1493
• refactor(webconnectivitylte): use NewHTTPTransportWithOptions by @bassosimone in #1494
• doc(webconnectivitylte): clarify http_transaction_{start,end} semantics by @bassosimone in #1495
• refactor: move webconnectivitylte algos to webconnectivityalgo by @bassosimone in #1496
• feat(webconnectivityalgo): test OpportunisticDNSOverHTTPSURLProvider by @bassosimone in #1497
• feat(webconnectivityalgo): test DNSWhoamiService by @bassosimone in #1498
• fix(DNSWhoamiService): implement cache expiration by @bassosimone in #1499
• feat(webconnectivitylte): use random DNS-over-UDP resolver by @bassosimone in #1500
• fix(CDEPS/tor): allow compiling under ArchLinux by @bassosimone in #1501
• fix(webconnectivitylte): include network events by @bassosimone in #1503
• fix(webconnectivitylte): include client_resolver by @bassosimone in #1504
• fix(qatool): reduce generated test cases churn by @bassosimone in #1505
• fix(webconnectivitylte): never sort test keys by @bassosimone in #1506
• fix(webconnectivitylte): use scope for endpoint IDs by @bassosimone in #1507
• fix(webconnectivitylte): don't use a DoH URL provider singleton by @bassosimone in #1508
• fix(minipipeline): sort A before AAAA by @bassosimone in #1509
• fix(qatool): normalize test keys by @bassosimone in #1510
• fix(qatool): make Date header constant by @bassosimone in #1511
• fix(qatool): do not save large response bodies on disk by @bassosimone in #1512
• fix(webconnectivitylte): add 10k*i scope to all IDs by @bassosimone in #1513
• cleanup(netemx): simplify idna and large-file test cases by @bassosimone in #1514
• fix(qatool): remove remaining causes of churn by @bassosimone in #1515
• fix(webconnectivitylte): add classic and tcptls_experiment tags by @bassosimone in #1502
• fix(gardener): avoid issues caused by stale databases by @bassosimone in #1516
• oohelperd: move prometheus metrics behind HTTP basic auth + docker image build + codepipeline buildspec by @hellais in #1520
• fix(tlsmiddlebox): if RemoteAddr is IPv6 set IPV6_UNICAST_HOPS by @Lanius-collaris in #1517
• chore(deps): bump google.golang.org/protobuf from 1.31.0 to 1.33.0 by @dependabot in #1519
• fix(pkg/gobash/version.go): validate zip files content by @bassosimone in #1521
• doc(gobash.yml): explain what to do during releases by @bassosimone in #1523
• chore: upgrade C dependencies by @bassosimone in #1524
• fix(torsf): disable integration tests by @bassosimone in #1525
• feat(oonimkall): add generic HTTP transaction support by @bassosimone in #1526
• chore: update oohttp and oocrypto by @bassosimone in #1527
• chore: prepare release 3.21.0 by @bassosimone in #1528
• chore: upgrade dependencies (1/N) by @bassosimone in #1530
• chore: update psiphon by @bassosimone in #1522
• fix(torsf): update domain fronting by @bassosimone in #1531

Full Changelog: v3.20.0-alpha...v3.21.0-alpha