Inconsistent result of bun test in Local MacOS and GitHub Actions Ubuntu #7386

Activity

1. ImBIOS

   added

   bugSomething isn't workingSomething isn't working

   on Dec 1, 2023
2. Jarred-Sumner commented on Dec 1, 2023

   

   Jarred-Sumner

   on Dec 1, 2023

   Collaborator

   More actions

   i have a feeling this is going to be an Intl library thing but i haven't read the code

   👍React with 👍1Reacted by Imamuzzaki Abu Salam

   😄React with 😄1Reacted by Imamuzzaki Abu Salam
3. simylein commented on Dec 1, 2023

   

   simylein

   on Dec 1, 2023

   Last edited by simylein

   Contributor

   More actions

   If your library happens to do any kind of file reading the sorting will be different on Linux to macOS
4. ImBIOS commented on Dec 1, 2023

   

   ImBIOS

   on Dec 1, 2023

   Last edited by ImBIOS

   ContributorAuthor

   More actions

   library/src/utils/num-in-words-factory.test.ts:
     (pass) numInWordsFactory > should return a function when called [0.04ms]
     
     Error: Expected []
     
           at /home/runner/work/i18n-num-in-words/i18n-num-in-words/library/src/utils/num-in-words-factory.test.ts:49:4
     44 |     const fn = (num: number) => `one`;
     45 |     const factory = numInWordsFactory(fn, { lang });
     46 | 
     47 |     factory(1, { experimental: true });
     48 | 
     49 |     expect(warnSpy).toHaveBeenCalled();
             ^
     error: expect(received).toHaveBeenCalled()
     
     Expected []
     
           at /home/runner/work/i18n-num-in-words/i18n-num-in-words/library/src/utils/num-in-words-factory.test.ts:49:4
     (fail) numInWordsFactory > should warn when experimental is true [0.21ms]
     The fn (en) feature is not stable yet. Please enable the experimental flag to use it.
     (pass) numInWordsFactory > should handle experimental false and non-stable status [0.11ms]
     (pass) numInWordsFactory > should handle experimental false and stable status [0.06ms]
     The fn (en) feature is not stable yet. Please enable the experimental flag to use it.
     (pass) numInWordsFactory > should handle experimental false and default status [0.06ms]
     The fn (en) feature is not stable yet. Please enable the experimental flag to use it.
     (pass) numInWordsFactory > should return an error when experimental false and non-stable status [0.06ms]
     The number 9007199254740992 is too large to be converted.
     (pass) numInWordsFactory > should handle large numbers [0.05ms]
     
     Error: Expected []
     
           at /home/runner/work/i18n-num-in-words/i18n-num-in-words/library/src/utils/num-in-words-factory.test.ts:135:4
     130 | 
     131 |     // Call the factory again with the same number
     132 |     res = factory(staticNum);
     133 | 
     134 |     expect(res).toBe(staticWord);
     135 |     expect(fn).toHaveBeenCalledTimes(1);
             ^
     error: expect(received).toHaveBeenCalledTimes(expected)
     
     Expected []
     
           at /home/runner/work/i18n-num-in-words/i18n-num-in-words/library/src/utils/num-in-words-factory.test.ts:135:4
     (fail) numInWordsFactory > should handle memoization [0.13ms]
     (pass) numInWordsFactory > should handle debug mode [0.13ms]
     
     Error: Expected []
     
           at /home/runner/work/i18n-num-in-words/i18n-num-in-words/library/src/utils/num-in-words-factory.test.ts:158:4
     153 | 
     154 |     // Call the factory twice with the same number
     155 |     factory(staticNum, { debug: true });
     156 |     factory(staticNum, { debug: true });
     157 | 
     158 |     expect(fn).toHaveBeenCalledTimes(1);
             ^
     error: expect(received).toHaveBeenCalledTimes(expected)
     
     Expected []
     
           at /home/runner/work/i18n-num-in-words/i18n-num-in-words/library/src/utils/num-in-words-factory.test.ts:158:4

   @simylein I'm not doing anything near that, it's just a library to change integer numbers into internationalized strings.

   Previous version of bun having consistent result as Node.js and Jest result tho.

   Kudos to @oven-sh, the test is always blazingly fast.
5. Electroid

   added

   bun:testSomething related to the `bun test` runnerSomething related to the `bun test` runner

   on Dec 1, 2023
6. josh- commented on Mar 19, 2025

   

   josh-

   on Mar 19, 2025

   More actions

   Also running into this - could it be related to differences in the ICU library between macOS and Ubuntu?

   For example, consider this code:

   new Date(1712880000000).toLocaleTimeString("en-US", {
     year: "numeric",
     month: "short",
     hour: "2-digit",
     minute: "2-digit",
     hour12: false,
   });

   on macOS this is Apr 2024 at 10:00 however on Ubuntu (GitHub Actions) this is Apr 2024, 00:00 (note , instead of at)

   in both places Intl.DateTimeFormat().resolvedOptions().locale resolves to en-US.

   when testing the browsers I have installed on my macOS machine, Safari returns Apr 2024 at 10:00 and Chrome returns Apr 2024, 10:00.
7. linear

   assigned

   dylan-conway

   on Jul 17, 2025
8. nektro

   unassigned

   dylan-conway

   on Nov 25, 2025
9. robobun

   marked Inconsistent bun test Result / Succes Locally (Linux), Error in GitHub Action (Linux) #9764 as a duplicate of this issue on Aug 15, 2026