These bottles are made from polystyrene aka #6 plastic which is not recyclable. Other probiotic drinks may be bottled in other materials. Check the bottom of the bottle for the resin number. If there is no resin number, it is almost certainly #6. 

The wrap

The wrap on value packs (ie when multiple bottles are sold together) is also not recyclable. Throw that out.

The foil

The small size of the foil cap is such that it will likely get filtered out of any recycling system. So you can throw it out or put it inside, say, an aluminum can before putting it in a recycling bin.