It fruits on the stems it put up during last year, so you need to be sure to leave those. On mine, the ones that fruit die back, so they are "easy" to remove (apart from the collateral damage to oneself from the spines on the beast). If in doubt, leave alone and just cut off anything that's in the way.