Could be a good idea. We have one tree on our site in London - it must be years old and generally doesn't do much but this year it is covered with fruit, hundreds of pounds of apricots.
Given the right cultivar and the right climate you could be on to a winner esp if you like apricot jam!
