Yes, sometimes they did make payments on tings, including horses.
I have a floor model Victrola (record player), my Aunt's father bought second hand in about 1920 or so for $14. I also have the reciepts he got for some of the 50 cent weekly payments.
Horses were considerably more expensive.