message-size-increase #3

sashakoshka · 2025-05-14T15:22:01-06:00

sashakoshka commented

2025-05-14 15:22:01 -06:00

Solves the METADAPT portion of #2, another branch and PR will be made to address the TAPE portion.

sashakoshka added 36 commits 2025-05-14 15:22:05 -06:00

METADAPT-B can now send very large messages 174634a330

METADAPT-B supports setting a message length limit 1ac0ed51c7

Add new METADAPT protocol specifications from #2 5c28510342

Add ReceiveReader to Transaction interface 4eae69dc94

design: State support for TCP/TLS b07cdf088a

Do not require METADAPT to return a message length when getting a reader fe8f2fc3ea

Support getting a reader for a message in METADAPT-B f4f8039fa0

Change the size limit type to an int64 db10355c84

WIP METADAPT-A changes e4f13a4142

Fix method signature of SetSizeLimit 6de3cbbc48

Name return values of decodeMessageA 7a766b74d8

METADAPT-A tests run f34620c434

METADAPT-B tests run 945d81c505

Actually use defaultSizeLimit fac0c4e31d

Encode METADAPT-A MMBs properly lmao 46c6361602

Allow readerA.pull to return an actual result cbaff8b593

Close METADAPT-A transaction channel 8fe3ba8d4f

Make the TestConnA pass 86cf3ee89d

Make TestEncodeMessageAErr pass 9bf0c596ba

This should have been in the last commit f6fe9c307d

More robust integer comparison 87c4ac8efb

Pass TestDecodeMessageBErr 47645a8fce

Add a SendWriter method to Trans c51a81bc13

Clarify concurrency in Trans methods 8a3df95491

Implement SendWriter for METADAPT-A 41f5cfefab

Change the result of Trans.SendWriter to a WriteCloser dd89245c34

Update METADAPT-A implementation 9d2bbec7f9

Implement SendWriter for METADAPT-B 7a0bf64c17

Send a close message when METADAPT-A transactions close c0bfcc02f7

Break METADAPT-A client/server environment from TestConnA a83aedc128

Fix transaction ID counting 23c37c3d1f

Finally fix A... this took too long d60beccbcd

Remove unneeded code 2fdf7d490d

Remove quic 218949bd46

It's clear it won't survive this change because I can't even test
it, so who knows if its good enough to have in main.

Fix some outdated doc comments 0b98c768b3

design: Fix documentation on message payload length 83443b8c88

sashakoshka added 1 commit 2025-05-15 15:52:13 -06:00

Change the protocol definition for tape to conform to #2 835d623087

sashakoshka added 1 commit 2025-05-15 15:57:02 -06:00

design: Remove note about this limitation dd5e7e96d5

sashakoshka added 2 commits 2025-05-16 19:42:54 -06:00

tape: Add GBEU encoding/decoding support 1b25e306a6

tape: Clean up a05c034313

sashakoshka added 8 commits 2025-05-18 14:09:13 -06:00

tape: EncodeGBEU returns the amount of bytes written 8d5ba2fa39

tape: Add N length support to all types 4438210963

tape: Break out array code into separate file c3337641bc

tape: Remove array tests from types_test.go 2080d60793

tape: Integer encoding accepts oversize buffers now 4f3b256821

tape: Add table encoding/decoding functions 3d8a012477

tape: Remove old "pairs" encoding f50b2ca0cd

tape: Improve table decoding 568431f4c3

sashakoshka added 5 commits 2025-05-18 14:34:51 -06:00

tape: Add back iter compatibility for table decoding 3a88619f9b

tape: Test "n" sizes of integer types f4fb5e80b9

tape: Fix "n" size returned by DecodeGBEU 6e5a7115d3

tape: Fix types_test.go not getting values for n in some cases 37c3e49833

tape: Fix table decoding restarting after each pull dd5325b351

sashakoshka added 1 commit 2025-05-18 15:59:28 -06:00

tape: Make table decoding more robust 0e7e935374

sashakoshka added 1 commit 2025-05-18 19:33:02 -06:00

tape: Improve table tests 23c3efa845

sashakoshka added 5 commits 2025-05-22 22:16:17 -06:00

tape: Implement PASTA and VILA encoding/decoding 2b3a53052f

tape: Add DecodeVILAIter 32df336c3e

tape: Update tape.String to include ~[]byte a927b9519e

tape: Switch StringArray over to using VILA 134daacc03

tape: Fix capitalization of Uint 717754644c

sashakoshka added 3 commits 2025-05-30 19:35:04 -06:00

codec: Add codec package to handle encoding and decoding ints, etc 83fa77ba13

codec: Add missing WriteByte function 58514f6afe

design: New TAPE design c4a985f622

sashakoshka added 1 commit 2025-05-31 04:18:28 -06:00

design: Remove description of NIL value 99392d50fc

sashakoshka added 3 commits 2025-06-04 08:36:18 -06:00

design: Add note about TAPE root values 38132dc58c

tape: Clean slate b85f3e7866

design: Initial PDL design b261aa32f1

sashakoshka added 1 commit 2025-06-04 08:37:19 -06:00

generate: Clean slate d67a4fb9f2

sashakoshka added 1 commit 2025-06-04 08:39:07 -06:00

design: Markdown fixes lol 385c5a5972

sashakoshka added 5 commits 2025-06-07 20:39:53 -06:00

design: Remove requirement for magic bytes in PDL file bb5fc89cc5

generate: Add PDL lexer 127aa23a61

generate: Add PDL parser 8ece6436b8

generate: Add PDL language structures 6bc98b3f77

Remove markdown, add goparse from go.modo 272a4da3c2

sashakoshka added 1 commit 2025-06-08 04:01:49 -06:00

generate: Remove commented out import a1f297e5b5

sashakoshka added 7 commits 2025-06-21 17:27:50 -06:00

Big nasty commit to add code generation for encoding ce503c4689

Merge codec and tape packages 285e83d995

tape: Implement encoding for "any" values c4407d9759

generate: Use tape.EncodeAny for encoding undefined tables 376a3f1b46

tape: Add float functions to the encoder 663cab6b77

tape: Add tag functions to the encoder 7b8240cec6

tape: Remove GBEU 65e8d51590

sashakoshka added 1 commit 2025-06-21 17:28:42 -06:00

tape: Add Tag.WithoutCN for easier comparison 89153dd7bd

sashakoshka added a new dependency 2025-06-27 11:36:39 -06:00

#4 Module name is still hopp for some reason

sashakoshka added 9 commits 2025-06-27 12:04:26 -06:00

internal/testutil: Add test utility package e3487d26a1

tape: Add String method to Tag 477e56d359

tape: Fix Encoder.WriteUintN not using the value AT ALL! 1bc0788ff2

tape: Implement dynamic decoding (untested) 9932abd6c4

tape: Fix comment 604faf0995

internal/testutil: Fix Snake giving false positives for long data 712b4f521c

tape: Fixes to dynamic encoding e16fec3a81

tape: Fix KTV decoding not recognizing the any type b174015319

tape: DecodeAny only returns an error when there is one aa718cfe9f

sashakoshka added 2 commits 2025-06-27 17:05:48 -06:00

tape: Fix size decoding math 2a4e88d949

tape: Send reflect values where possible instead of pointers 3eb826735b

sashakoshka added 3 commits 2025-06-28 04:25:09 -06:00

tape: Encoder inherits bufio.Writer, need to do same for decoder 08fe3d45dd

tape: Progress on dynamically decoding OTAs 37eccc91c0

tape: In progress testing of dynamic encoding/decoding e1f58a194a

sashakoshka added 1 commit 2025-06-28 09:25:00 -06:00

tape: Make decoder inherit bufio.Writer 4930215166

sashakoshka added 2 commits 2025-06-29 08:31:07 -06:00

tape: Change how slice skeletons are generated, support nested OTAs 81ac10508b

tape: Fix usage of Encoder/Decoder in dynamic tests 8f8cd91b5d

sashakoshka added 1 commit 2025-06-29 09:07:33 -06:00

internal/testutil: Snake.String and HexBytes return "EMPTY" when input is empty dcf923b1f3

sashakoshka added 2 commits 2025-06-29 11:23:08 -06:00

internal/testutil: Formatting fix e9633770ad

tape: Flush writer after encoding for testing 2138d47f07

sashakoshka added 1 commit 2025-07-02 04:25:36 -06:00

tape: WIP 07fc77c83e

sashakoshka added 1 commit 2025-07-04 10:23:05 -06:00

tape: Fix peekSlice not using the correct tag c8a2f03ca1

sashakoshka added 3 commits 2025-07-04 12:30:53 -06:00

tape: Fix negative slice length 5989a82bee

tape: Remove print statements 877698d402

tape: Change name of test to TestEncodeDecodeAnyTable c118a4d7ef

sashakoshka added 3 commits 2025-07-05 17:15:06 -06:00

internal/testutil: Create function to closely examine any data 6ba70ed046

tape: Use tu.Describe() in tests 1b82f2cd83

tape: Fix TestEncodeDecodeAny using int instead of uint32 0f20c4cdab

sashakoshka added 1 commit 2025-07-05 20:11:19 -06:00

tape: Ignore type names when encoding primitives using reflection 76a8f9444a

sashakoshka added 2 commits 2025-07-07 14:01:35 -06:00

generate: Add stub return to generateDecodeValue so it compiles f1df5fa84d

generate: Add framework for testing output of generated code a9d5bb83a2

sashakoshka added 3 commits 2025-07-08 09:40:02 -06:00

generate: Fix testGenerateRun so that it actually works c70c23d137

generate: What the fuck is a teibibyte 9bc90b0e17

generate: Update tests to account for new changes 8a0ae9b03f

sashakoshka added 1 commit 2025-07-08 10:01:39 -06:00

generate: Fix syntax errors in generated code e75d7534c1

sashakoshka added 2 commits 2025-07-08 13:44:52 -06:00

generate: Fix a bunch of semantic issues with the generated code cdba8ee601

generate: Change comment so it gets detected by the regex for generated files 9ff317d443

sashakoshka added 3 commits 2025-07-08 19:50:47 -06:00

generate: Fix more semantic issues in generated code a210f6112c

generate: Fix more semantic issues with generated code e48be0bc15

generate: Fix more semantic errors in the generated code 3bf365a7a9

sashakoshka added 1 commit 2025-07-10 19:56:25 -06:00

generate: Parse primitive types into actual types rather than named types 5a3296a842

sashakoshka added 1 commit 2025-07-10 19:57:27 -06:00

tape: Add StringTag 2305814e10

sashakoshka added 1 commit 2025-07-11 18:11:08 -06:00

generate: Fix more nonsense surrounding named types af7669c783

sashakoshka added 2 commits 2025-07-16 13:10:13 -06:00

generate: Generate Method method daa6a44179

generate: Emit stub for message decoding function d3d7b07a74

sashakoshka added 1 commit 2025-07-16 20:57:43 -06:00

generate: Implement decoding (untested) b73f9fa7ce

sashakoshka added 1 commit 2025-07-17 08:26:53 -06:00

generate: The test now compiles b826cbf83e

sashakoshka added 1 commit 2025-07-17 09:20:10 -06:00

generate: Fix the testEncode function b50a199842

sashakoshka added 1 commit 2025-07-17 09:38:26 -06:00

generate: Use newTemporarVar in more places f646207ab1

sashakoshka added 2 commits 2025-07-18 04:08:57 -06:00

generate: testEncode uses snakes now 4955f66ad6

generate: Flush the buffer before trying to compare it a257902705

sashakoshka added 1 commit 2025-07-19 04:24:48 -06:00

generate: And now for an actual use of testGenerateRun 7e8b272ef0

sashakoshka added 2 commits 2025-07-20 08:26:43 -06:00

generate: Fix TestGenerateRun e2b9e809a8

generate: Fix encoding of table length field 2c57423838

sashakoshka added 3 commits 2025-07-20 21:22:40 -06:00

generate: Make output of testGenerateRun easier to compare 272e47224d

generate: Fix array encoding not writing length or item tag properly 0f626b2e93

generate: Test array encoding ad3973dd9e

sashakoshka added 2 commits 2025-07-21 12:12:04 -06:00

generate: Test integer encoding b8047585fb

generate: Encode SI properly 6017ac1fa3

sashakoshka added 1 commit 2025-07-21 12:33:03 -06:00

generate: Fix TestGenerateRun so it snakes around User tables 51ed6aed9f

sashakoshka added 3 commits 2025-07-21 13:01:24 -06:00

generate: Fix syntax error when reading floats 3ef7de118b

generate: Test encoding floating point values 8b63166ba1

generate: Fix another syntax error when reading floats f009a970cd

sashakoshka added 2 commits 2025-07-21 14:55:45 -06:00

tape: Add functions to encode and decode float16 5d84636b55

generate: Fix TestGenerateRun when testing numbers 6ecc33a46b

sashakoshka added 3 commits 2025-07-25 19:02:14 -06:00

generate: Gracefully discard unexpected data while decoding f222fb02b7

generate: WIP test of nested arrays 59cc90166f

generate: Add TODOs about a big problem... 40444ee2f4

sashakoshka added 25 commits 2025-08-06 19:11:15 -06:00

design: Import issue from Tebitea (it is down) dcbfbe9141

generated: Remove unneeded code c86f9b03f2

generate: Add String functions, TypeHash function for types fae702edfd

generate: Add Generator.generateDecodeBranch stub 41b3376fa3

generate: Remove abort parameter df3fe1280d

design: Add paragraph about how we need a skimming function in tape a1bfae443c

generate: Implement Generator.generateDecodeBranch b15c3aa76c

generate: Add branch decode function request queue 711ac30486

generate: Add "stub" for actually generating branch functions 7dcfc08678

generate: Decode arrays (but don't validate their length yet) 2cbf58d558

generate: Decode tables (but don't validate their length yet) c4dd129fc5

generate: Validate OTA tags properly a9f583d2e7

generate: Fix array element tag variable 7343cf5853

generate: Properly check assignment within <message>.Decode 1118b11bcd

generate: Do the same for <user-type>.Decode 30e9ead1ab

generate: Fix syntax and formatting errors 12142706e1

generate: make branch functions generic, take in ~ of base type fa4f591126

generate: Pass decoder to branch functions 195d0f9725

generate: Break line after continue statements 77c6b67d65

generate: Fix bad variable names 170f79c914

generate: Convert int64 to int to satisfy range c18e251b4a

This is a stupid fucking restriction

generate: Fix no return statement, unused variables a99d4dee66

generate: The generics idea didn't work, use type names instead a270c22cb9

generate: Generator compiles 57c30ac669

Merge pull request 'branched-generated-encoder' (#9 ) from branched-generated-encoder into message-size-increase a108e53cb6

Reviewed-on: #9

sashakoshka added 1 commit 2025-08-06 20:17:22 -06:00

generate: Finish test sub-case for MessageNestedArray 4fbb70081a

sashakoshka added 9 commits 2025-08-11 19:11:04 -06:00

tape: Add LSI to Tag constants 8e14a2c3f1

tape: Add encoding and decoding of signed integers 52f0d6932e

tape: Test dynamic encoding and decoding of signed integers fe973af99c

tape: Actually test decoding lol 024edfa922

tape: Do something when receiving an LSI tag 1058615f6f

design: Change tag for signed PDL integers 02196edf61

generate: Update tests with new TNs 0e03f84b8a

generate: Support LSI tags dc72cc2010

Merge pull request 'encode-signedness' (#13 ) from encode-signedness into message-size-increase 8beb9de256

Reviewed-on: #13

sashakoshka added 3 commits 2025-08-12 06:21:45 -06:00

tape: Dynamic tests put out more information 1bded9852d

tape: Use reflection when encoding integers fdf0aa89a4

tape: Test that integers of a user-defined type can be encoded 96c8d7924f

sashakoshka added 3 commits 2025-08-18 20:28:22 -06:00

tape: Write test for Skim function 2209763666

tape: Implement Skim function 2180d29615

tape: Utilize skimming in the dynamic decoder a4da33536c

sashakoshka added 5 commits 2025-08-20 10:59:34 -06:00

generate: Clean up generate_test.go 0acf44886a

generate: Add decoder test function to testGenerateRun 9278bdcb43

testutil: Add Flatten method to Snake 423f547da3

generate: Significantly improve testGenerateRun 94041f2abc

generate: Add TestGenerateRunDecode 52aa07a98f

sashakoshka added 4 commits 2025-08-20 13:22:14 -06:00

hopp: Bring some old decoding/encoding functions that worked on []byte back 782472aa8f

hopp: Delete message.go a59870cc69

hopp: Point METADAPT implementations at new decoding functions 756bc79c16

generate: Fix comparisons in generated canAssign function 5d0b95d59a

sashakoshka added 1 commit 2025-08-21 04:26:23 -06:00

generate: Run encoder output through decoder in tests d6f6a3485c

sashakoshka added 1 commit 2025-08-21 16:29:42 -06:00

generate: Cause MessagePulse test case to pass (float was too precise) 4fd15c79a4

sashakoshka added 2 commits 2025-08-26 04:18:27 -06:00

generate: Import the wrong type test from the dynamic encoder/decoder 2db7ff88c2

generate: cast certain types when encoding 0097dbeedd

sashakoshka added 1 commit 2025-08-26 22:43:28 -06:00

generate: cast integers when decoding de6099fadc

sashakoshka added 2 commits 2025-08-27 16:34:34 -06:00

generate: Cast strings and buffers when decoding 77bfc45fea

generate: Fix problems with TestGenerateRunDecodeWrongType 087b6b6690

sashakoshka added 1 commit 2025-08-27 20:22:24 -06:00

generate: More fixes for TestGenerateRunDecodeWrongType 15c5f0b2b8

sashakoshka added 3 commits 2025-08-27 20:59:26 -06:00

generate: Don't hardcode filename as test.pdl in errors 4dc8a30ebd

cmd/hopp-generate: Update generate command ea17e354a3

generate: Fix float encoding 743a5d4ae0

sashakoshka commented

2025-08-27 21:01:29 -06:00

another branch and PR will be made to address the TAPE portion

Did not turn out this way

> another branch and PR will be made to address the TAPE portion Did not turn out this way

sashakoshka added 1 commit 2025-08-28 07:03:48 -06:00

hopp: Clarify documentation for Conn.SetSizeLimit 80c7d25c73

sashakoshka added 2 commits 2025-08-28 07:32:09 -06:00

tape: Add limits to the API 9d40b81e00

tape: Respect limits when dynamically encoding 80161b37f7

Still need: dynamic decoding, static decoding, static encoding

sashakoshka added 1 commit 2025-08-28 10:34:55 -06:00

tape: Respect limits when dynamically decoding e28ab4dc6b

sashakoshka added 1 commit 2025-08-28 10:52:15 -06:00

generate: Respect limits when statically encoding ae79a32309

sashakoshka added 1 commit 2025-08-28 10:54:12 -06:00

generate: Respect limits when statically decoding 0ea7e222cc

sashakoshka added 2 commits 2025-09-05 16:30:50 -06:00

tape: Safely cast when dynamically encoding/decoding 04c352fad6

generate: Safely cast in the static decoder 44fb561758

sashakoshka added 1 commit 2025-09-05 16:48:36 -06:00

hopp: Add SetDeadline methods to Conn and Trans 12fbfa6293

sashakoshka commented

2025-09-07 19:27:05 -06:00

Everything has been implemented, but not fully tested. This branch already got out of scope once, so it will be merged now.

sashakoshka merged commit 5b1448be3e into main

2025-09-07 19:27:38 -06:00

sashakoshka referenced this issue from a commit

2025-09-07 19:27:46 -06:00

Merge pull request 'message-size-increase' (#3) from message-size-increase into main

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Blocks

#4 Module name is still hopp for some reason

sashakoshka/hopp

Reference: sashakoshka/hopp#3