Note that any clean paper items can be recycled as paper. See here. That includes anything without food waste.

But do note that small items like straws are likely to get filtered out at the sorting plant. Even so, if they are clean & dry, it does not hurt to put them in the recycling bin.