Answer
It would alter the types of bacteria that can compete and thrive in your gut, though it may or may not affect the overall level of diversity.
Work Step by Step
The types of foods you eat affect what kinds of bacteria can thrive in your gut. Depending on how you changed your diet, an overall reduction in diversity could result, or it could be increased. This would depend on the type of change and what your diet was previously.