Background: A comprehensive study of what individuals with inflammatory bowel disease (IBD) are eating that encompasses food avoidance, dietary sugar consumption, and a comparison with the non-IBD Canadian population has not been documented. The aim was to analyze these interrelated dietary components. Methods: Food avoidance and sugar intake data were collected from 319 patients with IBD enrolled in the University of Manitoba IBD Cohort Study. Diets of those with IBD (n = 256) were compared with a matched, non-IBD Canadian cohort using the nutrition questions obtained from the Canadian Health Measures Survey (CHMS). Results: Food avoidance among IBD is prevalent for alcohol, popcorn, legumes, nuts, seeds, deep-fried food, and processed deli meat, with a higher prevalence among those with active IBD. Patients with active IBD also consumed significantly more portions of sports drinks and sweetened beverages compared with those with inactive disease. Compared with the non-IBD Canadian population, patients with IBD consume significantly less iron-rich food but more milk. Conclusions: Food avoidance is common among those with IBD but may be due more to personal preferences, while sugar-laden beverages may be displacing other foods higher in nutrients. The overall diet of patients with IBD differed from that of the non-IBD Canadian population, but deficiencies were observed in both groups. Considering malnutrition among persons living with IBD, nutrition education by trained dietitians as part of the IBD team is imperative to address food avoidance and overall balance nutrition as part of treating and preventing nutrition deficiencies.