People consider it to be trashy, despite the fact that it’s actually helpful, and it tidies up the table if the waiter is busy. I think it’s considered poor etiquette because rich snobs would never perform the tasks of the paid servants. Those tasks are beneath them. So if you want to be seen as fancy, you need to act as if they’re beneath you as well.