if theyre outdoors, youll be getting wind rain and dust of sorts on em...thus making it damn near impossible to find prints let alone be able to ID em. but if that sort of thing make you paranoid, just wear gloves.
If leo wants to investigate then those prints could be incriminating. Chances are if your not growing fields they wont pursue the forensic invest.. Some other things to consider, are your prints on police or federal databases? And plant small patches instead of huge crops,you know, eggs in one basket type of thing.