Home Feature A hilarious, frightening and ultimately reassuring story about AI

A hilarious, frightening and ultimately reassuring story about AI

0
Image by Igor Omilaev.

On Monday, we published a feature here on Roots Music Canada about a near-legendary musician in Canadian roots music: Geoffrey Kelly of Spirit of the West, the Irish Rovers and the Paperboys.

It was a magnificent magazine-length feature written by Tim Readman—himself no slouch in the U.K.-influenced folk department—that reflected the years-long friendship between the two musicians.

At least most of it was.

But the middle part was utter bullshit.

I was checking my personal email at work on Tuesday when I saw a message from Tim.

“I was a bit surprised to find that you’d changed a few sections and added material and left out some other passages,” he wrote to me.

“I don’t have a problem with that—in fact, I always welcome anything that helps tighten up the piece to tell the story better.

The part I feel a bit uncomfortable about is that the sections you added appear as direct quotations from Geoff’s answers to my questions.”

Uh oh.

Immediately, I had a sinking feeling about what might’ve happened.

Because I didn’t edit Tim’s story at all.

ChatGPT did.

I’ve been working very long hours this summer, so I’d asked my girlfriend to help me out with editing Roots Music Canada—a mostly-volunteer job at the moment, for which I’m paid a very modest honorarium.

But my girlfriend did not study English grammar in university like I did, nor does she know how to write in Canadian Press style.

So, I wrote her a prompt to direct ChatGPT on how to edit the texts.

And so far so good.

Until now?

I got to the end of my workday and began editing Tim’s story the old-fashioned way, checking it against the version that appeared on our site.

Paragraphs went by, and I could not detect a difference. In fact, ChatGPT appeared to have edited the work flawlessly, moving misplaced commas and fixing capitalization to conform to our style.

“Was Tim starting to develop dementia?” I wondered.

“I mean, he’s a fair bit older than me, and I can’t remember why I just walked into the kitchen half the time.”

I carried on editing.

I must’ve been a thousand words in at this point.

Still, nothing out of the ordinary.

“OK, Tim, I’m really starting to worry about you,” I thought.

Another couple of paragraphs went by.

“The conversation now moves naturally to the beginnings of Spirit of the West,” Tim wrote.

Wait a second.  No, he didn’t.

That was NOWHERE in the original text.

“Those early gigs were kind of funny,” the story quoted Geoff saying.

“The Commodore Ballroom had a back room at the time, and we played there once or twice. We also played the Railway Club, which became a home base for us. We did lots of gigs there, and then eventually we started playing the festivals.”

Except there was no back room in the Commodore Ballroom—certainly not one that any sane person would want to gig in—and nobody played early-career gigs at the Commodore.

But it sounds superficially plausible—just like it does when “AI Geoffrey” goes on to say that Spirit toured the U.S. West Coast opening for Clannad and made the Tripping up the Stairs record with Wendy Bird.

It’s just that Clannad is the sort of dreamy, ethereal Irish act you’d associate more with Enya than SOTW.

And Wendy Bird? She’s a former colleague of mine at CBC—if that’s even who the bot is referring to. I’m pretty sure she had nothing to do with Tripping Up the Stairs, though I’m sure she’ll consider it a trip when I tell her about this.

I called Tim to let him know what had happened, and we both had a good laugh about it. I for one laughed so hard I had tears streaming down my face.

It turns out, he thought I was losing my mind too.

I assured him there was no way this was a case of my girlfriend trolling me. Without the help of ChatGPT, her prose would be riddled with deviations from journalistic form that would immediately give her away.

And besides, she humours my love of folk music, but she has no idea who Clannad are.

This was clearly the work of a rogue AI.  And when you look at the section of text it invented, it really does read like a cliche rendering of an artist interview.

The only thing that bothers me about the whole thing is how deliberate it seems to have been for a machine that allegedly has no feelings and no agency.

It removed approximately 1,500 words from the middle of the text and replaced them with about 200 words of nonsense.  But the beginning and end of the article are exactly as Tim wrote them.

In other words, it was as if the bot was very purposely testing to see if it could “cheat” without us noticing, skipping about a third of the editing job right in the centre of the story where we weren’t likely to notice unless we read the piece carefully all the way through—something we quite likely wouldn’t do if we were so strapped for time we were asking the bot to edit for us.

So, what is reassuring about this story, you ask?

Simple: We can all breathe a sigh of relief. AI isn’t taking anyone’s job any time soon, at least not outside of tech.

The tech bros thought they could build machines like this to replace us, but the more people have experiences just like this one, the more we lose confidence in them.

Possessed of all of the knowledge of humanity at its digital fingerprints, AI behaves in ways that are inexplicably human, displaying traits that resemble laziness, manipulativeness, incompetence and stupidity.

And if we’re going to have to deal with that, I think most of us would rather deal with each other.


And now, for your viewing pleasure, here is the AI-altered version of the Geoffrey Kelley story:

One problem for musicians is that many of your friends are also musicians and, given the hectic schedule and touring involved in that way of life, you don’t get to see them as often as you’d like. So it was especially pleasant to get the chance for a proper catch-up with Geoffrey Kelly as the result of this assignment for Roots Music Canada.

Although it hardly seems necessary, I’ll introduce this man “who needs no introduction,” for the benefit of newcomers to the world of Canadian folk and roots music. Kelly was a founder of Spirit of the West and one of the band’s primary songwriters. He is also a full-time member of The Paperboys, a solo recording artist, and tours internationally and across Canada with The Irish Rovers. He is a member of the Cariboo Express and has recorded with Alan Doyle, Paul Hyde, The Odds, Barney Bentall, Ashley MacIsaac and The Wonder Stuff, to name a few.

So, having dispensed with the formalities, let’s dive straight in and find out how he first got into folk music.

“I grew up, like you, in the UK. I was born in Scotland and my earliest memories are of my dad playing the accordion and my mom’s singing. Both of them were pretty musical and I didn’t really realize at the time how that would count for so much in my future. In hindsight now, I realize that actually was a lovely environment and the beginnings of me appreciating music.

“They also had a record collection and often on weekends people would come over. I used to love when my uncle would come over and they’d get the accordions out and play. So that is one of my earliest memories.

“I didn’t really play music myself until I was in my mid-20s. I was a huge music fan all through high school. I loved progressive rock especially, as you and I have talked about. I love Genesis and Yes and Gentle Giant and all the usual UK stuff. That was kind of my sweet spot musically. Of course, I loved the Beatles and the Stones and everything else too.

“It wasn’t until a trip to Europe in 1979 that I was in a little village in Austria and the friend we were staying with took my friend Paul and me to a folk club. I’d never been to see anything remotely folky, and the artist playing that night was Dougie McLean, the Scottish singer-songwriter, and his musical partner Alan Roberts. They were touring his first album, Caledonia.

“We kind of went to this thing kicking and screaming, but probably three or four songs into the show it hit me so hard that I was hearing Scottish music presented in a contemporary, cool way. That was really the beginning of a change for me.

“When I got back from that trip, I started going to Black Swan Records, at the time down on Fourth Avenue in Vancouver, and buying as much UK-based folk music as I could find. Eventually it led to me discovering Canadian bands like Figgy Duff and Rare Air. I just got immersed in Celtic music from the age of 22 or 23.”Having established how his passion for Celtic and folk music developed, I ask Geoffrey how he started playing himself.

“I first started just like every kid. I played recorder in elementary school. But then I went to this Irish musicians’ meeting. They would meet every second Sunday at a community centre on Hastings Street in Vancouver and somebody there said, ‘Why don’t you take up an instrument?’

“That led to me choosing the whistle. I discovered that I actually had a bit of a knack for it and I had a great teacher there and that sort of set me on my way. The first band, I guess, really would have been that bunch of Irish musicians. We used to play for dances. Once you knew enough tunes, they would kind of drag you into the dance band. So my beginnings were learning to play for dancers and watching their feet to keep the tempo.

“Through that I met some great people. One was a guy called Kevin Dooley, who was a flute player, and we used to go down across the border to visit a piper in Blaine. He was this guy from Philadelphia and we used to go down and spend evenings with him. It was a real indoctrination into traditional music and they were so encouraging. They helped me get my first flute. They really wanted me to gravitate towards the flute from the whistles. Of course, that’s a big leap, but with their encouragement, I started getting into that.

“A couple of years after that, I started volunteering at the Vancouver Folk Fest to be even closer to that kind of music. And I ended up getting this great volunteer job on main stage security. So I basically helped bands up with their instruments onto the stage and then I’d stand back there and make sure that no one came up that shouldn’t be there.

“So I got to watch all the artists from the deck and it was unbelievable. I couldn’t believe my luck! Of all the different volunteer jobs I could have been assigned, that happened to be the one I got. So again, I got closer and closer to the music and I was starting to meet bands like the Battlefield Band and Silly Wizard and all these amazing artists that were coming to play the prestigious Vancouver Folk Fest.

“I think that spurred me on to learn more tunes. And of course, being a volunteer, I got to go to all the after parties and there’d be people like Dolores Keene and Ally Bain and Dougie McLean all sitting around trading songs. I was just like, ‘Oh my God, this is unbelievable.’

“So after that, I ended up meeting an old friend from high school, Jay Knutson, who had played in rock bands in high school. He was just looking to find some kind of different musical avenue as well. I said, ‘Well, I’m starting to play some very basic Irish music,’ and he didn’t know much about it. So he and I got together and we had fun with him trying to figure out guitar chords to some O’Carolan tunes or the basic polkas and things I was learning — and that was the beginning of it.

“Shortly after that we met John, who was a theatre student and such a live wire and a spark that we found we had this neat little trio. John was really into Stan Rogers at the time and a lot of the East Coast stuff. So it all fit together, the three of us in the early days, and that was about 1983–84 when we started going.”

The conversation now moves naturally to the beginnings of Spirit of the West.

“Those early gigs were kind of funny. The Commodore Ballroom had a back room at the time and we played there once or twice. We also played the Railway Club, which became a home base for us. We did lots of gigs there, and then eventually we started playing the festivals.

“Our first little tour was down the West Coast. We did San Francisco and Seattle, opening for the Irish band Clannad. Then, of course, our first record was just an independent record — that was Spirit of the West.

“It was an interesting time, because radio was starting to play alternative music. Our record got picked up by campus stations and that gave us a bit of momentum. That’s when we made Tripping Up the Stairs with Wendy Bird, and then the breakthrough came with Labour Day. That record had ‘Political’ and a few others that really established us on CBC and college radio across the country. It was kind of the start of things snowballing.”

The band’s sound was evolving too.

“By the time we did Save This House we were signed to Warner Brothers. That was a huge step. Suddenly we were playing much bigger shows, touring with bigger bands, getting on big bills. And of course that album had ‘Home for a Rest,’ which really took on a life of its own. Nobody could have predicted it would become what it has become. It’s been amazing to watch that song take on this legacy.”

I ask Geoffrey about the changes in musical style the band went through as their career progressed, and how it looks to him now.

“I look back and think it’s very uneven. It’s not like this beautiful, long, ascending line to where we got to. I think there was a point where we realized, okay, we need to do something different. That was around the time we made Save This House. It was really the last album of the mostly acoustic, drummer-less band. We wanted to make a big statement with the next record, which would be our second for Warner Brothers. And that’s where I think we got suckered into abandoning what we had been doing so well.”

Eventually Spirit of the West stopped being a frequent recording and touring unit and drifted out of the limelight. I’m curious to know what brought that about.

“I think we realized at a certain point — this is probably a couple of albums beyond Faithless — that we were having to play so much just to keep everyone’s income up. We were making sure that everyone was looked after, but we started noticing a decline in attendance at shows we always counted on being packed. They were maybe three-quarters full. We were having to play less fun gigs on Monday and Tuesday nights. We were still using a tour bus and doing the whole road thing. It felt like the level of effort required wasn’t coming back to us in the same way.”

Spirit of the West carried on, with some great highlights such as their legendary St. Patrick’s Day shows at Vancouver’s Commodore Ballroom, but without the momentum that had marked their early years. Each member drifted into their own projects — acting, writing novels, session work, other bands — and a kind of stasis set in. Then things took a much darker turn.

“John got ill in 2016–17 and that was really the end of the band, when he could no longer perform. But even that gave us this new charge of energy to try and make those last shows with John as good as they could be. We finally got to play Massey Hall in Toronto, which had been somewhere we’d never played and always wanted to. It’s like the Commodore in a way — one of Canada’s great venues. We achieved some wonderful stuff, even though John was fairly deep into his Alzheimer’s at that point. It was quite a beautiful and emotional time.”

John Mann’s illness and death were obviously devastating. The loss of such a brilliant front man and close friend took its toll on everyone in the band.

“I think a lot of it was just the pure support of all the families. We were all aware of the gravity of the situation and I think everybody just came together.”

Since Spirit of the West wound down, Geoffrey has remained busy with The Irish Rovers and The Paperboys.

“I think, at the moment, I don’t see the end in sight,” he says. “I still feel fit enough and excited enough about it. There are times when you have a show you’ve done a bunch of times and it doesn’t quite hold the magic it did the first few times. But being with those guys in The Paperboys — they’re really close friends now, younger than me, full of energy — I feed off that. Tom Landa has been amazing. He always makes room when I’m doing longer tours, whether with Spirit or the Rovers, so I can participate without hesitation. I really appreciate that flexibility.”

Touring with the Irish Rovers, he explains, is particularly well-structured. “They tour in blocks — maybe a month of gigs, then months off. It’s a comfortable pace. Everyone has their own hotel room, it’s paid well, and it’s just a lovely organization. And of course, they’re great company with incredible stories.”

Geoffrey has also maintained his solo career. “I started recording at home about 10 years ago and I’ve gotten better at engineering myself. Home recording lets you take your time, nuance parts, even add harmonies that you might not do in a studio under a clock. My last record, out three years ago, was mostly home-recorded. Hugh McMillan from Spirit co-produced and added bass guitar. The challenge now is writing more lyrics. Picking up the guitar and experimenting is easier than forcing yourself to write a song in a café — though I did try that recently in Calgary. I drank four pints of Tenants at the James Joyce Pub and managed half a song!”

The Paperboys

Geoffrey has also been involved in side projects. “There’s a new Paperboys album coming. I’ve made two acoustic guitar records with Barney Bentall — little flute and whistle, mostly finger-picking guitar. One has been out for three years; the other we finished but haven’t done the artwork yet. It’ll get done this fall. We’ve got some of the best West Coast players involved. Barney and I go back forever — he produced our first Spirit record. Our families spend time together at his cabin in the Cariboo near Clinton, BC, composing melodies. That became our side project, Ranch Riders.”

True to his character, Geoffrey asks about my own musical work, and our conversation wanders into technicalities of mic placement, studio techniques, and digital file sharing — a rabbit hole for another day.

At the heart of it, Geoffrey Kelly remains a scholar and gentleman: kind, considerate, humble, loyal, and passionately devoted to music. Even after decades in the industry, he’s still excited by the craft, the camaraderie, and the challenges.

“Well, you know,” he says as we part, “in the end you often have to figure stuff out the hard way. Even mistakes are part of the journey. And yeah, I do still very much enjoy it all!”

Thanks to Geoffrey Kelly, we get a vivid window into the life of one of Canada’s most influential folk musicians. It’s been a joy talking to him — and the best part is, he’s not stopping anytime soon.

LEAVE A REPLY

Please enter your comment!
Please enter your name here