Increased max_tbatch_size to kMaxBatchSize. Gives 1.5x speed-up for prefill on both intel and AMD machines#895

copybara-service[bot] merged 1 commit intodevgoogle/gemma.cpp:devfrom

test_899532036google/gemma.cpp:test_899532036Copy head branch name to clipboard