Finally someone asking the question, when I was experimenting with int8 vs fp16 like 6mo ago the results were mixed and barely . Curious to see if any progress has been made. https://www.reddit.com/user/we_are_mammals