Workaround: Build testing on resource constrained computer (/tmp partition too small)

[rickhg12hs]

I ran into an issue where I could build qsv but I couldn't run the tests. My /tmp was filling up, so all I had to do was redirect all the temporary testing files to someplace that had more room using the TMPDIR environment variable.

Here was the problem:

$ RUST_MIN_STACK=33554432 CARGO_BUILD_RUSTFLAGS='-C target-cpu=native' cargo build -j 3 --features all_features --bin qsv --release --locked && RUST_MIN_STACK=33554432 CARGO_BUILD_RUSTFLAGS='-C target-cpu=native' cargo test -j 1 --features all_features --bin qsv --release --tests --test tests --future-incompat-report --locked
    Finished `release` profile [optimized] target(s) in 4.89s
    Finished `release` profile [optimized] target(s) in 1.04s
note: 0 dependencies had future-incompatible warnings
     Running unittests src/main.rs (target/release/deps/qsv-a3ef5d6a96dba113)

running 35 tests
test cmd::joinp::test_tsvssv_delim ... ok
test cmd::extdedup::test_extdedup_mem_check ... ok
test cmd::validate::test_parse_dynenum_uri ... ok
test cmd::fetch::test_apply_jaq_invalid_json ... ok
test cmd::validate::tests_for_csv_to_json_conversion::test_to_json_instance ... ok
test cmd::validate::tests_for_csv_to_json_conversion::test_to_json_instance_cast_integer_error ... ok
test cmd::validate::tests_for_schema_validation::test_validate_with_error ... ok
test cmd::validate::tests_for_schema_validation::test_validate_with_no_errors ... ok
test config::tests::test_csv_extension ... ok
test config::tests::test_no_extension ... ok
test config::tests::test_snappy_csv_extension ... ok
test config::tests::test_snappy_tsv_extension ... ok
test config::tests::test_ssv_extension ... ok
test config::tests::test_tsv_extension ... ok
test config::tests::test_unknown_extension ... ok
test odhtcache::tests::test_basic_cache ... ok
test odhtcache::tests::test_custom_config ... ok
test odhtcache::tests::test_disk_cache_operations ... ok
test cmd::validate::test_dyn_enum_validator ... ok
test odhtcache::tests::test_duplicate_inserts ... ok
test odhtcache::tests::test_edge_cases ... ok
test odhtcache::tests::test_large_string_chunking ... ok
test cmd::validate::test_validate_currency_email_dynamicenum_validator ... ok
test cmd::validate::test_load_json_via_url ... ok
error: test failed, to rerun pass `--bin qsv`

Caused by:
  process didn't exit successfully: `/usr/local/src/rust/qsv/target/release/deps/qsv-a3ef5d6a96dba113` (signal: 7, SIGBUS: access to undefined memory)

$ df -h /tmp
Filesystem      Size  Used Avail Use% Mounted on
tmpfs           3.9G  3.9G     0 100% /tmp

$ du -h -s /tmp/.tmp* /tmp/qsv-extdedup-QYRHbO.tmp 
0	/tmp/.tmp2WC2He
992M	/tmp/.tmpBUc6jk
1.2G	/tmp/.tmpE7JdFt
811M	/tmp/.tmpm5dK9Y
869M	/tmp/qsv-extdedup-QYRHbO.tmp

And here's my workaround:

$ rm -fr /tmp/.tmp* /tmp/qsv-extdedup-QYRHbO.tmp 

$ TMPDIR=/usr/local/src/rust/tmp RUST_MIN_STACK=33554432 CARGO_BUILD_RUSTFLAGS='-C target-cpu=native' cargo build -j 3 --features all_features --bin qsv --release --locked && TMPDIR=/usr/local/src/rust/tmp RUST_MIN_STACK=33554432 CARGO_BUILD_RUSTFLAGS='-C target-cpu=native' cargo test -j 1 --features all_features --bin qsv --release --tests --test tests --future-incompat-report --locked
    Finished `release` profile [optimized] target(s) in 3.84s
    Finished `release` profile [optimized] target(s) in 0.99s
note: 0 dependencies had future-incompatible warnings
     Running unittests src/main.rs (target/release/deps/qsv-a3ef5d6a96dba113)

running 35 tests
test cmd::joinp::test_tsvssv_delim ... ok
test cmd::extdedup::test_extdedup_mem_check ... ok
test cmd::validate::test_parse_dynenum_uri ... ok
test cmd::fetch::test_apply_jaq_invalid_json ... ok
test cmd::validate::tests_for_csv_to_json_conversion::test_to_json_instance ... ok
test cmd::validate::tests_for_csv_to_json_conversion::test_to_json_instance_cast_integer_error ... ok
test cmd::validate::tests_for_schema_validation::test_validate_with_error ... ok
test cmd::validate::tests_for_schema_validation::test_validate_with_no_errors ... ok
test config::tests::test_csv_extension ... ok
test config::tests::test_no_extension ... ok
test config::tests::test_snappy_csv_extension ... ok
test config::tests::test_snappy_tsv_extension ... ok
test config::tests::test_ssv_extension ... ok
test config::tests::test_tsv_extension ... ok
test config::tests::test_unknown_extension ... ok
test odhtcache::tests::test_basic_cache ... ok
test odhtcache::tests::test_custom_config ... ok
test odhtcache::tests::test_disk_cache_operations ... ok
test cmd::validate::test_dyn_enum_validator ... ok
test odhtcache::tests::test_duplicate_inserts ... ok
test odhtcache::tests::test_edge_cases ... ok
test odhtcache::tests::test_large_string_chunking ... ok
test cmd::validate::test_validate_currency_email_dynamicenum_validator ... ok
test cmd::validate::test_load_json_via_url ... ok
test odhtcache::tests::test_temp_dir_creation ... ok
test odhtcache::tests::test_disk_cache_persistence ... ok
test odhtcache::tests::test_memory_limit_behavior ... ok
test odhtcache::tests::test_zero_memory_limit ... ok
test util::tests::benchmark_hash_sha256_file ... ok
test util::test_hw_survey ... ok
test util::tests::test_hash_sha256_file ... ok
test util::tests::test_hash_sha256_file_large ... ok
test odhtcache::tests::test_limit_memory ... ok
test util::tests::benchmark_hash_sha256_file_large ... ok
test util::tests::benchmark_hash_sha256_file_very_large ... ok

test result: ok. 35 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 53.23s

     Running tests/tests.rs (target/release/deps/tests-ada8b1bd14e2bb16)

running 2027 tests
test test_100::lesson_1::fruits_cat ... ok
test test_100::lesson_1::fruits_extended_table ... ok
test test_100::lesson_0::fruits_headers ... ok
test test_100::lesson_1::fruits_extended_table_condense ... ok
test test_100::lesson_1::fruits_extended_table_pad ... ok
test test_100::lesson_0::fruits_count ... ok
test test_100::lesson_0::fruits_count_total ... ok
test test_100::lesson_1::fruits_extended_table_width ... ok
test test_100::lesson_1::fruits_raw_fmt ... ok
test test_100::lesson_1::fruits_raw_select ... ok
test test_100::lesson_1::fruits_raw_slice ... ok
test test_100::lesson_1::fruits_table ... ok
test test_100::lesson_1::fruits_raw_sqlp ... ok
test test_100::lesson_1::fruits_table_align_right ... ok

...

test test_validate::validate_with_fancy_regex ... ok
test test_validate::validate_with_no_format_validation_and_dynamic_enum ... ok
test test_validate::validate_with_no_format_validation_mixed_errors ... ok
test test_validate::validate_with_no_format_validation_success ... ok
test test_validate::validate_with_schema_noheader ... ok
test test_transpose::prop_transpose_in_memory ... ok
test test_transpose::prop_transpose_multipass ... ok

test result: ok. 1967 passed; 0 failed; 60 ignored; 0 measured; 0 filtered out; finished in 371.46s

[jqnatividad]

Good one!
We're starting to reach the disk space limits of GH's action runners as well, so test disk space reqts should be stable going forward...