The 'Magic Word' I Learned in an Elevator: The Day I Truly Felt 'Connection' in Japan

By NIHONGO-AI
AI Engineer/Japanese Language Educator
7/23/2025

The 'Magic Word' I Learned in an Elevator: The Day I Truly Felt 'Connection' in Japan
Introduction
Have you ever walked through the streets of Japan and felt "somehow lonely"?
Tokyo, with its towering skyscrapers. In packed trains, everyone stares at their smartphones, never making eye contact with the person next to them. Even when someone bumps into another person, they hurry away without apologizing... When I first arrived in Japan, this city felt cold and mechanical to me, like a place where "moving machines" had gathered.
"I'm starting to understand the language, but hearts aren't connecting"
What saved me from this dilemma was a common phrase found on the very first page of Japanese textbooks. In this article, I'll share the secret key to entering the "inside (uchi)" of Japanese society, which I learned from a small mistake in an elevator.
By reading this article, you'll learn three important things:
- The crucial difference between using "arigatou" and "sumimasen"
- The psychological structure of "wa" (harmony) and "burden" that Japanese people value
- Specific actions to overcome loneliness and smoothly blend into Japanese society
If you're feeling a bit tired of life in Japan right now, please read to the end. By the time you finish, tomorrow's scenery should look a little different.
Chapter 1: Cold Tokyo, Closed Doors
Three months after arriving in Japan, I was in the grip of intense "loneliness." Even when I used the polite expressions I learned at Japanese language school and smiled while saying "arigatou gozaimasu" to convenience store clerks, all I got back were scripted, emotionless responses. People passing by at the station seemed to have invisible barriers around them.
"Will I remain an 'outsider (soto)' in this country forever?"
Just when I was about to become convinced of this, something happened. I was visiting a large office building in Tokyo for a business meeting. Unfortunately, it was raining that day, and I was carrying large luggage and an umbrella, with both hands completely full.
As I tried to get into the elevator, a Japanese woman held the closing doors open with her hand, waiting for me.
"Ah, this is my chance!"
I seized the moment to express my heartfelt gratitude. Looking into her eyes with the biggest smile I could manage, I said loudly:
"Arigatou! Arigatou gozaimasu!"
However, her reaction at that moment was completely different from what I expected.
She quickly looked away and gave an indescribable, somewhat troubled, ambiguous smile. Then she shrank into the corner of the elevator, looking awkwardly down at her shoes.
I was shocked. I had expressed gratitude to someone who had been kind to me, so why did she seem so "uncomfortable"? Was it because my Japanese pronunciation was strange? Or was it because she didn't like being spoken to by a foreigner?
At that moment, what I saw through the gap of the closing doors wasn't her face, but an "insurmountable wall" between her and me.
Chapter 2: How a Small "Sumimasen" Changed the Atmosphere
The next day, I brought this frustration to Sato-sensei, a veteran instructor at my Japanese language school. She smiled gently and said:
"That's because you said 'arigatou.' In that situation, it was time for 'sumimasen'."
I was surprised and asked again. I thought "sumimasen" was a word used for apologizing (sorry). Wouldn't it be rude to apologize to someone who had been kind to you?
"No, the Japanese 'sumimasen' isn't just an apology. It's an expression of deep respect and consideration for the other person, meaning 'I'm sorry for troubling you and taking your time for someone like me'."
Sato-sensei wrote this on the whiteboard:
The lubricant of Japanese society = "Sumimasen"
"When someone uses their time or effort for you, Japanese people feel grateful while simultaneously feeling 'guilty' about being a burden. By putting that guilt into words and offering it, you can significantly close the emotional distance with the other person."
With this teaching in my heart, I decided to wait for a chance to try again.
The opportunity came quickly. The next evening, when I was about to get on an elevator at the station, this time a businessman-looking man was holding the door open for me.
Feeling a bit nervous, I kept my smile modest, bowed my head slightly, and said in an almost inaudible voice:
"Ah, sumimasen..."
Chapter 3: The 'Invisible Thread' That Words Create
At that moment, something incredible happened.
"Ah, iie (no problem)"
The man answered briefly with a gentle expression, waited for me to get on, and then pressed the button for my destination floor. Furthermore, when I got off first, he held the door open again and gestured "douzo (please go ahead)."
The "awkward atmosphere" that had flowed between yesterday's woman and me was nowhere to be found. There was definitely a warm, yet subtle "connection" there.
I realized what had happened. Yesterday, when I said "Arigatou gozaimasu!" with a beaming smile, I had unconsciously positioned the other person as "a perfect person doing me a favor" and myself as "a customer receiving that benefit."
However, by using the word "sumimasen," the message changed to this:
- In the case of "arigatou": "I receive and am grateful for the good thing (service) you did for me"
- In the case of "sumimasen": "I fully understand the trouble (care) you went through for me. I feel bad about it"
The "wa" (harmony) of Japanese society is built on exchanging these small "burdens of guilt (= consideration for others)." Japanese people aren't cold. They desperately try to be considerate of each other, "not to cause trouble" and "not to be a burden," while trying to sense each other's thoughtfulness.
The single word "sumimasen" was like a "receipt confirmation" to communicate "I notice your thoughtfulness."
Comparison Table: When to Use "Arigatou" vs "Sumimasen"
| Aspect | "Arigatou gozaimasu" | "Sumimasen (I'm sorry/grateful)" |
|---|---|---|
| Main emotion | Pure gratitude, joy | Gratitude + consideration for others, guilt about burden |
| Perspective | Focus on what you "received" | Focus on the trouble the other person "went through" |
| Interpersonal distance | Polite but with boundaries (guest-like) | Crossing boundaries to get closer (member-like) |
| Recommended scenes | Receiving gifts, receiving services | Being offered a seat, having doors opened for you |
Chapter 4: You Also Hold the Key to the "Inside"
If you're feeling "walls" in Japan right now, just once, try saying "sumimasen" in a situation where you want to say "arigatou."
That word becomes a secret key that opens the door to Japanese hearts from the inside, even when they seem closed.
5 Practical "Sumimasen" Scenarios You Can Try Today
- When someone gives up their seat for you on the train
- NG: "Arigatou gozaimasu! (with a big smile)"
- OK: "Ah, sumimasen. Arigatou gozaimasu (looking slightly apologetic)"
- When water is poured for you at a restaurant
- Example: Say "Ah, sumimasen" while moving your glass slightly toward the other person.
- When someone makes way for you on a narrow path
- Example: Without making eye contact, bow slightly and say "sumimasen" as you pass by.
- When a colleague passes you documents at the office
- Example: "Oisogashii tokoro sumimasen. Tasukarimasu (Sorry to bother you when you're busy. This helps a lot)"
- When someone picks up something you dropped
- Example: "Ah, sumimasen! Arigatou gozaimasu"
3 More Principles for Blending into the "Inside"
- Keep eye contact modest: Staring too intently makes Japanese people nervous. It's natural to lower your gaze slightly and say "sumimasen."
- Add "cushion words": Adding phrases like "when you're busy" or "when you're tired" doubles the power of "sumimasen."
- The spirit of "mutual consideration": When someone says "sumimasen" to you, respond with "iie" and a smile. This completes the exchange.
Common Mistakes: Q&A
Q1: Is it wrong to say "arigatou"? A: No, it's not wrong. However, shy Japanese people often don't know how to respond to "suddenly bright gratitude" from strangers and become confused.
Q2: Doesn't always apologizing make you feel like you're doing something wrong? A: Think of it separately from the Western concept of "apology." Consider Japanese "sumimasen" as a "word of acknowledgment" that recognizes the other person's kindness.
Q3: Is "sumimasen" appropriate in business situations too? A: In business, "osore irimasu" or "arigatou gozaimasu" are more appropriate. For everyday small kindnesses, "sumimasen" as described here creates the most familiarity.
Conclusion
How was that?
"Sumimasen" - just five syllables. When I learned to use this word correctly, I felt for the first time that I had become a member of the "inside (uchi)" of the large family that is Japanese society.
Key points from this article:
- "Sumimasen" is a "magic word" that acknowledges the other person's consideration.
- Japanese society maintains harmony (wa) through exchanging "small burdens of guilt."
- The Japanese way is to mix a little "apologetic feeling" with "arigatou."
What you can do starting today:
- When someone holds an elevator or door for you, don't hesitate to say "sumimasen."
- Don't stare too much into their eyes; add a light bow.
- Try adding a quiet "arigatou gozaimasu" after "sumimasen."
You are no longer a guest in this country. With that one word, the wall between you and the person next to you should simply disappear.
If this article was helpful, please share it on your social media. It might help someone else who is feeling lonely in Japan.
