We call those things prickly pear fruit. They're not native to Australia, but they grow all over the place anyway. They're a pest! I've tried them before and don't find them very satisfying. Quite bland and not really worth the effort it takes to eat them.
I have a small chilli tree growing with my other herbs in ceramic pots on my front porch. Aside from being great for cooking, they look fantastic too.