Can I turn off the background music?

Yes, you can turn off the background music very easily.

In the app preferences page, you will find that option under Audio effects: