Currently, in the JVM there are 8 kinds of primitive types, each one is associated with a \u201csignature letter\u201d of the alphabet:<\/p>\n\n\n\n
B<\/strong> byte signed byte On top of these, we have objects:<\/p>\n\n\n\n L<\/strong> ClassName reference an instance of class ClassName<\/p>\n\n\n\n You may have noted the signature letter if you printed out the result of Project Valhalla introduces a new letter for a new kind of types:<\/p>\n\n\n\n Q<\/strong> ClassName inline types<\/p>\n\n\n\n These new types will eventually replace the primitive types in our applications, removing current boxed types (Integer and such) and bringing a new seamless world based on Reference and Inline types only.<\/p>\n\n\n\n This is still in the future, for the moment let’s enjoy what is already available in the current Early-Access build.<\/p>\n\n\n\n To simplify the set-up, the Project Valhalla team released an Early-Access Build on August the 30th. <\/p>\n\n\n\n You can download it from here and configure it in JAVA_HOME as a normal JDK (version 14): http:\/\/jdk.java.net\/valhalla\/<\/a><\/p>\n\n\n\n Unfortunately at the moment (December 2019) IntelliJ and Gradle are not able to compile a source with the new features of the language. We need to use the JDK command-line tools or ant.<\/p>\n\n\n\n I shared on Github a repository<\/a> with several examples and the ant build scripts needed to run them.<\/p>\n\n\n\n Let’s start from something very simple, let’s define a Point type with two fields for the coordinates.<\/p>\n\n\n The only change is the inline keyword on line 1. Point is an Inline Type and now we will look at the differences with a normal class.<\/p>\n\n\n\n Some characteristics are still unfinished and they may not work in the current build or change how they work in future releases. In particular: <\/p>\n\n\n\n For a more comprehensive look at Project Valhalla features, see the articles linked at the end. Here we will concentrate on the performance aspect of it.<\/p>\n\n\n\n One of the most exciting features of the Inline Classes is the way in which arrays are created.<\/p>\n\n\n\n In the case of primitives, each position of the array has the direct representation of the type; for example, the 64 bits of a long in case of an array of long.<\/p>\n\n\n\n In the case of the referenced object instead, the array will only contain the reference to the object allocated memory on the heap.<\/p>\n\n\n\n This means that reading an object from an array involves first reading the reference and then fetching the memory from its actual location. If the object has referenced fields, those would also cause data to be fetched from a remote memory location. <\/p>\n\n\n\n Inline Types on the other side work like primitives.<\/p>\n\n\n\n To have a taste of how much this matters, let’s make a simple test program to sum all trades from a given account in a big array.<\/p>\n\n\n\n Here is our trade’s simple representation, with an amount, an account and a traded security.<\/p>\n\n\n Similarly, we will define a After the compilation, we can use And this is the output:<\/p>\n\n\n Note the value modifier in the first line and the methods hashCode, equals, and toString that are not present in our class. <\/p>\n\n\n\n Our Unfortunately at the moment is not possible to flatten String and Arrays inside an Inline type. There are future plans for something called Array 2.0 that would allow for that.<\/p>\n\n\n\n What we can do now instead, is to squeeze a String inside a The In our case, we assume that the Security and the Account have a maximum length of 10 characters and they are composed only of uppercase letters, numbers and a limited number of special characters.<\/p>\n\n\n\n This is the code of our We will define a This is the generated ByteCode:<\/p>\n\n\n Note how the descriptor for the Finally, to have a fair comparison, we also define a You can find the complete code in my GitHub repository<\/a>.<\/p>\n\n\n\n Before looking at the performance, let’s look how our Trade objects are using the memory.<\/p>\n\n\n\n First the standard On the left, there is our big array. Then a pointer to the TradeRef object, and then two other pointers to the strings.<\/p>\n\n\n\n Depending on the order of creation, these can be quite far apart in our heap.<\/p>\n\n\n\n This is a performance problem because fetching memory from different regions is one of the slowest operations for a CPU.<\/p>\n\n\n\n This classic post from Martin Thomson is one of the better explanations: Let’s look at a simple diagram of the InlineTrade value memory representation now:<\/p>\n\n\n\n Here the whole value is directly on the array. For this reason, the array is actually bigger than in the first case. If you don’t allocate all objects, in other words, if your array mostly contains null values, this can be a drawback.<\/p>\n\n\n\n Finally, let’s see how the TradeMiniString is allocated in the memory:<\/p>\n\n\n\n You can see that it stays completely inside the array element, with no external pointers.<\/p>\n\n\n\n This is possible only because we accept big limitations on what can be contained in those strings; still, it’s an acceptable compromise when using strings only for storing ID from a database or the stock ticker symbols.<\/p>\n\n\n\n To compare the performance we can create four arrays of 5 million elements, one for each of our trade types:<\/p>\n\n\n Then we fill them with identical random values:<\/p>\n\n\n And finally, we do searches on each one repeatedly, printing out the time elapsed.<\/p>\n\n\n We don’t care much about specific numbers here, so we just keep looping and print the results. The timings tend to stabilize after a few minutes when the Java Hotspot compiler optimizes and inlines most of the methods.<\/p>\n\n\n\n We can filter and sum using two methods: a for loop or a nicer stream map and reduce:<\/p>\n\n\n Unfortunately, streams are not (yet) working with Inline Classes:<\/p>\n\n\n So for the moment we can only measure performance using for loops.<\/p>\n\n\n\n The actual numbers are not very important here, so I just grabbed a significative sample running the application on my Linux laptop.<\/p>\n\n\n\n Rather than the numbers, we are interested in how fast they are relative to each other.<\/p>\n\n\n\n We can see here how in this case the improvement is really huge: inline TradeMiniString is more than 20x faster!<\/p>\n\n\n\n Event compared with the TradeRefEncoded is still 6x faster!<\/p>\n\n\n\n This seems almost too good to be true, so we can use a better method to measure the actual performance.<\/p>\n\n\n\n Brendan Gregg wrote some very useful tools to use Linux kernel perf tool to profile Java programs.<\/p>\n\n\n\n There are several blog posts on how to produce and how to read flame graphs: And here are our flames:<\/p>\n\n\n\n You can find the actual svg file in the GitHub repository here<\/a>.<\/p>\n\n\n\n We can see four green blocks (including the one with the arrow) that are a representation of how much time these four methods used the CPU. In this graph, the green blocks are Java calls, while the red ones are kernel system calls.<\/p>\n\n\n\n The spikes are other methods, related to the print out of results and garbage collection. We can ignore them.<\/p>\n\n\n\n From the left, the first block is the InlineTrade, using normal strings. It is clearly smaller than the last two blocks which represent the TradeRef and TradeRefEncoded.<\/p>\n\n\n\n As you may have guessed, the block pointed by the arrow is the TradeMiniString duration, it is so brief that you can read only a few characters of the name.<\/p>\n\n\n\n The relative duration of each method from the perf profile is reported in this graph:<\/p>\n\n\n\n The relative timings are similar, Inline is 6 times faster than Ref and Inline Encoded is 5.5 times faster than Ref Encoded.<\/p>\n\n\n\n It is still too early for precise measurements, but it is already clear that Valhalla inline types have the potential to bring a massive performance boost for a certain type of critical applications.<\/p>\n\n\n\n There are still many rough edges and painful decisions to make but the overall shape of the Valhalla project is very exciting.<\/p>\n\n\n\n Since the last Early-Access build there have already been many improvements in the source code, let’s hope to have another stable build to test soon with more features.<\/p>\n\n\n\n The full code of this and other examples: A Recent video about Valhalla at Devoxx BE Brian Goetz on the State of Valhalla An in-depth explanation of Inline Types from Ben Evans:
C<\/strong> char Unicode character encoded with UTF-16
D<\/strong> double double-precision floating-point value
F<\/strong> float single-precision floating-point value
I<\/strong> int integer
J<\/strong> long long integer
S<\/strong> short signed short
Z<\/strong> boolean true or false<\/p>\n\n\n\ntoString()<\/code> method for a generic object.<\/p>\n\n\n\n
\n\n\n\nGetting Started<\/h2>\n\n\n\n
A Valhalla POINT<\/h2>\n\n\n\n
\ninline public class Point {\n public int x;\n public int y;\n\n public Point(int x, int y) {\n this.x = x;\n this.y = y;\n }\n}\n<\/pre><\/div>\n\n\nCode like a Class<\/h2>\n\n\n\n
Work like an int<\/h2>\n\n\n\n
Work in progress<\/h2>\n\n\n\n
Compact Arrays<\/h2>\n\n\n\n
\npublic class TradeRef {\n public final double amount;\n public final String account;\n public final String security;\n\n public TradeRef(double amount, String account, String security) {\n this.amount = amount;\n this.account = account;\n this.security = security;\n }\n\n @Override\n public boolean equals(Object o) {\n if (this == o) return true;\n if (o == null || getClass() != o.getClass()) return false;\n TradeRefEncoded that = (TradeRefEncoded) o;\n return Double.compare(that.amount, amount) == 0 &&\n account == that.account &&\n security == that.security;\n }\n\n @Override\n public int hashCode() {\n return Objects.hash(amount, account, security);\n }\n}\n<\/pre><\/div>\n\n\nTradeInline<\/code> class, identical with the inline modifier:<\/p>\n\n\n\ninline public class TradeInline {\n final double amount;\n final String account;\n final String security;\n\n public TradeInline(double amount, String account, String security) {\n this.amount = amount;\n this.account = account;\n this.security = security;\n }\n}\n<\/pre><\/div>\n\n\njavap<\/code> from the command line to print the generated ByteCode:<\/p>\n\n\n\njavap -s antbuild\/com\/ubertob\/ministring\/TradeInline.class \n<\/pre><\/div>\n\n\n
\npublic final value class com.ubertob.ministring.TradeInline {\n final double amount;\n descriptor: D\n final java.lang.String account;\n descriptor: Ljava\/lang\/String;\n final java.lang.String security;\n descriptor: Ljava\/lang\/String;\n public final int hashCode();\n descriptor: ()I\n\n public final boolean equals(java.lang.Object);\n descriptor: (Ljava\/lang\/Object;)Z\n\n public final java.lang.String toString();\n descriptor: ()Ljava\/lang\/String;\n\n public static com.ubertob.ministring.TradeInline com.ubertob.ministring.TradeInline(double, java.lang.String, java.lang.String);\n descriptor: (DLjava\/lang\/String;Ljava\/lang\/String;)Qcom\/ubertob\/ministring\/TradeInline;\n}\n<\/pre><\/div>\n\n\nencoding a string into a long<\/h2>\n\n\n\n
TradeInline<\/code> class has still two String inside as fields. Can we inline them?<\/p>\n\n\n\nlong<\/code> type, although we need to accept some limitations.<\/p>\n\n\n\nlong<\/code> type has 64 bits, so using a base 64 encoding (6 bits) we can store up to 10 characters inside.<\/p>\n\n\n\nMiniString<\/code> inline type, with the encoding and decoding static functions:<\/p>\n\n\n\ninline public class MiniString {\n\n long raw;\n\n public MiniString(String str) {\n raw = encode(str);\n }\n\n public String get() {\n return decode(raw);\n }\n\n public static final int MAX_MINISTR_LEN = 10;\n public static final int MINI_STR_BASE = 64;\n public static final String letters = "=ABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789 _-!?.$&%@#:[]{}()*<>:;',\/^";\n\n public static long encode(String str) {\n String prepared = prepareString(str);\n long encoded = 0;\n for (char c : prepared.toCharArray()) {\n int x = letters.indexOf(c);\n encoded = encoded * MINI_STR_BASE + x;\n }\n return encoded;\n }\n\n private static String prepareString(String str) {\n StringBuilder prepared = new StringBuilder();\n for (char c : str.toCharArray()) {\n if (letters.indexOf(c) >= 0)\n prepared.append(c);\n if (prepared.length() > MAX_MINISTR_LEN)\n break;\n }\n return prepared.toString();\n }\n\n public static String decode(long number) {\n StringBuilder decoded = new StringBuilder();\n long remaining = number;\n\n while (true) {\n int mod = (int) ( remaining % MINI_STR_BASE);\n char c = letters.charAt(mod);\n decoded.insert(0, c);\n if ( remaining < MINI_STR_BASE)\n break;\n remaining = remaining \/ MINI_STR_BASE;\n }\n return decoded.toString();\n }\n}\n\n<\/pre><\/div>\n\n\nTradeMiniString<\/code> inline type using our new MiniString<\/code> for Account and Security.<\/p>\n\n\n\n\npublic final value class com.ubertob.ministring.TradeMiniString {\n final double amount;\n descriptor: D\n final com.ubertob.ministring.MiniString account;\n descriptor: Qcom\/ubertob\/ministring\/MiniString;\n final com.ubertob.ministring.MiniString security;\n descriptor: Qcom\/ubertob\/ministring\/MiniString;\n public final int hashCode();\n descriptor: ()I\n\n public final boolean equals(java.lang.Object);\n descriptor: (Ljava\/lang\/Object;)Z\n\n public final java.lang.String toString();\n descriptor: ()Ljava\/lang\/String;\n\n public static com.ubertob.ministring.TradeMiniString com.ubertob.ministring.TradeMiniString(double, java.lang.String, java.lang.String);\n descriptor: (DLjava\/lang\/String;Ljava\/lang\/String;)Qcom\/ubertob\/ministring\/TradeMiniString;\n}\n\n<\/pre><\/div>\n\n\nMiniString<\/code> account starts with the Q of inline types and not with the L of the reference types.<\/p>\n\n\n\nTradeRefEncoded<\/code> class using the same trick to encode an Account and Security in a field of type long<\/code>.<\/p>\n\n\n\nTradeRef<\/code> object:<\/p>\n\n\n\n![\"\"](\"https:\/\/i0.wp.com\/cdn-images-1.medium.com\/max\/1040\/1%2AMJ5EQT7q64jc_Up7VW9EPQ.jpeg?w=600&ssl=1\")
<\/figure>\n\n\n\n
https:\/\/mechanical-sympathy.blogspot.com\/2012\/08\/memory-access-patterns-are-important.html<\/a><\/p>\n\n\n\n![\"\"](\"https:\/\/i0.wp.com\/cdn-images-1.medium.com\/max\/1040\/1%2ABeXWJLZ86v7_HJeRUllzlA.jpeg?w=600&ssl=1\")
<\/figure>\n\n\n\n![\"\"](\"https:\/\/i0.wp.com\/cdn-images-1.medium.com\/max\/1040\/1%2A8HKp5hn4sX5yRv93uvLC4Q.jpeg?w=600&ssl=1\")
<\/figure><\/div>\n\n\n\nPerformance Comparison<\/h2>\n\n\n\n
\n static final int arraySize = 5_000_000;\n\n public TradeRef[] tradeRefs = new TradeRef[arraySize];\n public TradeRefEncoded[] tradesRefEncoded = new TradeRefEncoded[arraySize];\n public TradeInline[] tradesInline = new TradeInline[arraySize];\n public TradeMiniString[] tradesMiniString = new TradeMiniString[arraySize];\n\n<\/pre><\/div>\n\n\n
\n public static void generatingTradesAndBrowing() {\n\n var tr = new TradeRepository();\n tr.fillWithRandomData();\n\n var searcherRef = new TradeRefBrowser(tr.tradeRefs);\n var searcherInline = new InlineTradeBrowser(tr.tradesInline);\n var searcherRefEncoded = new TradeRefEncodedBrowser(tr.tradesRefEncoded);\n var searcherMiniString = new MiniStringTradeBrowser(tr.tradesMiniString);\n\n var account = tr.tradeRefs[1000].account;\n\n while (true) {\n benchmarks(searcherRef, searcherInline, searcherRefEncoded, searcherMiniString, account);\n }\n }\n<\/pre><\/div>\n\n\n\n private static void benchmarks(TradeRefBrowser searcherRef, InlineTradeBrowser searcherInline, TradeRefEncodedBrowser searcherRefEncoded, MiniStringTradeBrowser searcherMiniString, String account) {\n cronoSum(() -> searcherRef.sumByAccountFor(account), "Ref with for");\n cronoSum(() -> searcherRef.sumByAccountStream(account), "Ref with stream");\n\n cronoSum(() -> searcherRefEncoded.sumByAccountFor(account), "RefEncoded with for");\n cronoSum(() -> searcherRefEncoded.sumByAccountStream(account), "RefEncoded with stream");\n\n cronoSum(() -> searcherInline.sumByAccountFor(account), "Inline with for");\n cronoSum(() -> searcherMiniString.sumByAccountFor(account), "MiniString with for");\n }\n<\/pre><\/div>\n\n\n\n public double sumByAccountStream(String account){\n return Arrays.stream(repo)\n .filter( trade -> trade.account.equals(account))\n .map(trade -> trade.amount)\n .reduce(0.0, (a, b) -> a+b);\n }\n\n public double sumByAccountFor(String account){\n double res = 0;\n for (int i = 0; i < repo.length; i++) {\n TradeRef tradeRef = repo[i];\n if (tradeRef.account.equals(account))\n res = res + tradeRef.amount;\n }\n return res;\n }\n<\/pre><\/div>\n\n\n\nException in thread "main" java.lang.ClassFormatError: Illegal class name "Qcom\/ubertob\/ministring\/TradeMiniString;" in class file <Unknown>\n at java.base\/jdk.internal.misc.Unsafe.defineAnonymousClass0(Native Method)\n at java.base\/jdk.internal.misc.Unsafe.defineAnonymousClass(Unsafe.java:1345)\n at java.base\/java.lang.invoke.InnerClassLambdaMetafactory.spinInnerClass(InnerClassLambdaMetafactory.java:324)\n at java.base\/java.lang.invoke.InnerClassLambdaMetafactory.buildCallSite(InnerClassLambdaMetafactory.java:192)\n at java.base\/java.lang.invoke.LambdaMetafactory.metafactory(LambdaMetafactory.java:329)\n at java.base\/java.lang.invoke.BootstrapMethodInvoker.invoke(BootstrapMethodInvoker.java:127)\n at java.base\/java.lang.invoke.CallSite.makeSite(CallSite.java:307)\n at java.base\/java.lang.invoke.MethodHandleNatives.linkCallSiteImpl(MethodHandleNatives.java:259)\n at java.base\/java.lang.invoke.MethodHandleNatives.linkCallSite(MethodHandleNatives.java:249)\n at com.ubertob.ministring.MiniStringTradeBrowser.sumByAccountStream(Unknown Source)\n\n<\/pre><\/div>\n\n\n
Fancy Graphs (finally)<\/h2>\n\n\n\n
![\"\"](\"https:\/\/i0.wp.com\/www.javaadvent.com\/content\/uploads\/2019\/12\/Screenshot-from-2019-12-10-21-26-37.png?resize=600%2C360&ssl=1\")
https:\/\/medium.com\/netflix-techblog\/java-in-flames-e763b3d32166<\/a><\/a><\/p>\n\n\n\n![\"\"](\"https:\/\/i0.wp.com\/www.javaadvent.com\/content\/uploads\/2019\/12\/flame_java_4.png?fit=600%2C219&ssl=1\")
<\/figure>\n\n\n\n![\"\"](\"https:\/\/i0.wp.com\/www.javaadvent.com\/content\/uploads\/2019\/12\/Screenshot-from-2019-12-10-21-26-52.png?resize=600%2C353&ssl=1\")
Conclusions<\/h2>\n\n\n\n
\n\n\n\nresources to learn more<\/h2>\n\n\n\n
https:\/\/github.com\/uberto\/testValueTypes<\/a><\/p>\n\n\n\n
https:\/\/devoxx.be\/talk\/?id=41660<\/a><\/p>\n\n\n\n
http:\/\/cr.openjdk.java.net\/~briangoetz\/valhalla\/sov\/02-object-model.html<\/a><\/p>\n\n\n\n
https:\/\/www.infoq.com\/articles\/inline-classes-java<\/a><\/p>\n\n\n\n