Leave early if you need to. Better for them and you to have a good experience and leave wanting more, than to leave in tears and frustration vowing never to come back again. Let them know ahead of time that you are going for just a bit of the service because it is important to you (as the parent). This way they won't feel like they are being punished by leaving early.
Talk with them before each service about the holy day. Thursday = day when Jesus washed his disciples feet and/or began the practice of Holy Communion. Friday = the day Jesus died. Saturday/Sunday = the day Jesus rose from the dead.
Bring a simple, non-messy snack for them to munch on during the service.
Ask a priest if there is something the child can help with during the service.
Sign-up to take a part in the service (you as a parent), and let your child stand by you while you do.
Bring reinforcements - if available, a family friend, godparent, or grandparent can be a really helpful presence with kids to help them stay calm.
There isn't Sunday School or Nursery on these days, intentionally: we want children to grow up experiencing and enjoying these services.
Finally, while all are important, we find Thursday and Saturday nights the most engaging to be at. Friday is a long service with lots of words: very powerful, but long and wordy.
We hope that helps! Children are full members of the community: able to participate, assist, and lead. They belong with the community - wiggles, noises, and all. Jesus made that clear. Let's follow his example and welcome them.