It sounds like you are talking about Sambucus Gaudichaudiana.
This is an Australian member of the elderberry genus, which grows as understory in dense forests. Unlike its northern hemisphere cousins this is not a large woody shrub. It more of a perennial plant, as its stems mostly die back to a perennial rootstock each autumn and fresh stems arise the following spring. The flowers are a little unusual, as the four white petals never spread widely, but remained curled inwards, so that the flowers look like white berries. The fruit ripens to a pale yellow translucent berry, which is edible. It is only likely to be hardy outdoors in the mildest areas of the UK.
