96e074d030
* Add kotlin code gen modules * Update kotlin to 1.2 * Add a serializable dummy class * Try using kapt configuration from kotlin-examples repo Still no luck! * Use proper allocated name for assignment too * Use selectName() API * Clean up constructor parameter annotations & plumbing for qualifiers * Updates poms and kotlin code gen processor to support tests. * Ignore kotlin code gen tests for now None of these are data classes tests right now, which is the only thing this supports right now * Replace $ with _ in class names for consistency * Shortcut Array types to arrayOf * Add DataClassTest * Try generated option first, fall back to maven after * More idiomatic handling * Only use nonnullable types for adapter properties * Code dump of kotshi tests * Comment out specifics to get compiling * Generics support! * Fix double primitive default * Pick up temporary snapshot for Any fix * Invariance should just be null * Better handling of nullably-bound variance * Just assume the first jvm constructor for now as jvmMethodSig is flaky * Specify types param if needed * Don't do lazy delegation * Clean up nullable typevariablename boundaries * Add type variables to extension function on companion object * Use properties instead of allocated names for more robustness Since we're already on a snapshot * If there are no type variables, make it null for simpler handling * Fix generics and Type[] handling * Fix unnecessary as casts on primitive defaults * Reference spec directly for possible bangs * Use nullSafe() adapters for anything nullable or with default values * Use object type in makeType() Types.java cares * Make TestPrimitiveDefaultValues work * Re-enable TestClassWithJavaKeyword * Ignore remaining tests that are pending decisions or JsonQualifier support * Remove customnames test as we're just going to stick with simple @Json * Add toString() implementations * Reenable default values testing, adapt to kotlin lang support * Remove primitive adapters bits since we're not using it * Clean up a bunch of leftover comments * Switch to only nullable handling, report missing properties This makes all nullable handling for local properties the same, and removes defaults for primitives in the process. It simplifies the handling a lot, and leans on kotlin language features to take care of null handling (null checking and then throwing the lazily evaluated list of missing properties). One minor change from what kotshi does - this reports the serialized name in the missing properties, not the property name. We could look at supporting this though if we want. * Implement JsonQualifier support * Use Kapt for AutoService/processor declaration * Checkstyle * Remove unused primite type checks * Add test verifying mutable and immutable collections work * Fix test name * Standardize isRequired checks * Add more nullability and mutability tests * Kotlinpoet 0.7.0 final * Switch to new vararg overload for annotation class adapter() * Make suffix just JsonAdapter without underscore * Switch to just a regular constructor for MoshiSerializableFactory * Remove constructor caching * Remove unnecessary framework class checks * Nix unnecessary superclass lookups, inline constructor lookup * Nix null token check in reads * Nix null check in writes, do !! on first value use * Nix null checks in favor of serializeNulls * Inline null checks and fail eagerly * Fix double _Adapter * First pass at simplifying adapter names * Inline names to options property, life into class and rm companion * Differentiate between absent and null, use nullSafe() as needed * Group together compile and test dependencies * Remove incorrect comment * Revert formatting * Set, not mutable set * Collapse else-if nesting to one when * Cleaner formatting test code * Collapse more to locals * Collapse more * Return a nonnullable type in fromJson * Remove redundant out variance * Use KClass where appropriate * End comment in period * Remove redundant comment * Throw on unrecognized type in simplified name * Use illegalargumentexception instead * Emit a nullcheck at the beginning of toJson instead * Remove extra newline * Simplify processing to be less abusive * Skip using asClassName() when possible * Use addComment() * Switch to declared constructors Technically more correct since we're defining these * Unmodifiable set * return adapter(type, annotationTypes[0]) * Slight optimization - check if the type is parameterized first If the type is a parameterized type, then we know they'll have the two-arg constructor. This way we don't always try and fail the single arg constructor on parameterized types * Add test for type aliases, optimize to reuse adapters if possible This is a tiny optimization to make type aliases (which did already work) reuse adapter properties if they already exist for the backing type. What this means is that if you have: typealias Foo = String and properties foo: Foo bar: String you'll only get one adapter property field for String, and both will use it * Use string templating where possible * Remove all the kotshi tests |
||
---|---|---|
.buildscript | ||
adapters | ||
examples | ||
kotlin | ||
kotlin-codegen | ||
moshi | ||
.gitignore | ||
.travis.yml | ||
CHANGELOG.md | ||
checkstyle.xml | ||
CONTRIBUTING.md | ||
deploy_javadoc.sh | ||
LICENSE.txt | ||
pom.xml | ||
README.md |
Moshi
Moshi is a modern JSON library for Android and Java. It makes it easy to parse JSON into Java objects:
String json = ...;
Moshi moshi = new Moshi.Builder().build();
JsonAdapter<BlackjackHand> jsonAdapter = moshi.adapter(BlackjackHand.class);
BlackjackHand blackjackHand = jsonAdapter.fromJson(json);
System.out.println(blackjackHand);
And it can just as easily serialize Java objects as JSON:
BlackjackHand blackjackHand = new BlackjackHand(
new Card('6', SPADES),
Arrays.asList(new Card('4', CLUBS), new Card('A', HEARTS)));
Moshi moshi = new Moshi.Builder().build();
JsonAdapter<BlackjackHand> jsonAdapter = moshi.adapter(BlackjackHand.class);
String json = jsonAdapter.toJson(blackjackHand);
System.out.println(json);
Built-in Type Adapters
Moshi has built-in support for reading and writing Java’s core data types:
- Primitives (int, float, char...) and their boxed counterparts (Integer, Float, Character...).
- Arrays, Collections, Lists, Sets, and Maps
- Strings
- Enums
It supports your model classes by writing them out field-by-field. In the example above Moshi uses these classes:
class BlackjackHand {
public final Card hidden_card;
public final List<Card> visible_cards;
...
}
class Card {
public final char rank;
public final Suit suit;
...
}
enum Suit {
CLUBS, DIAMONDS, HEARTS, SPADES;
}
to read and write this JSON:
{
"hidden_card": {
"rank": "6",
"suit": "SPADES"
},
"visible_cards": [
{
"rank": "4",
"suit": "CLUBS"
},
{
"rank": "A",
"suit": "HEARTS"
}
]
}
The Javadoc catalogs the complete Moshi API, which we explore below.
Custom Type Adapters
With Moshi, it’s particularly easy to customize how values are converted to and from JSON. A type
adapter is any class that has methods annotated @ToJson
and @FromJson
.
For example, Moshi’s default encoding of a playing card is verbose: the JSON defines the rank and
suit in separate fields: {"rank":"A","suit":"HEARTS"}
. With a type adapter, we can change the
encoding to something more compact: "4H"
for the four of hearts or "JD"
for the jack of
diamonds:
class CardAdapter {
@ToJson String toJson(Card card) {
return card.rank + card.suit.name().substring(0, 1);
}
@FromJson Card fromJson(String card) {
if (card.length() != 2) throw new JsonDataException("Unknown card: " + card);
char rank = card.charAt(0);
switch (card.charAt(1)) {
case 'C': return new Card(rank, Suit.CLUBS);
case 'D': return new Card(rank, Suit.DIAMONDS);
case 'H': return new Card(rank, Suit.HEARTS);
case 'S': return new Card(rank, Suit.SPADES);
default: throw new JsonDataException("unknown suit: " + card);
}
}
}
Register the type adapter with the Moshi.Builder
and we’re good to go.
Moshi moshi = new Moshi.Builder()
.add(new CardAdapter())
.build();
Voilà:
{
"hidden_card": "6S",
"visible_cards": [
"4C",
"AH"
]
}
Another example
Note that the method annotated with @FromJson
does not need to take a String as an argument.
Rather it can take input of any type and Moshi will first parse the JSON to an object of that type
and then use the @FromJson
method to produce the desired final value. Conversely, the method
annotated with @ToJson
does not have to produce a String.
Assume, for example, that we have to parse a JSON in which the date and time of an event are represented as two separate strings.
{
"title": "Blackjack tournament",
"begin_date": "20151010",
"begin_time": "17:04"
}
We would like to combine these two fields into one string to facilitate the date parsing at a
later point. Also, we would like to have all variable names in CamelCase. Therefore, the Event
class we want Moshi to produce like this:
class Event {
String title;
String beginDateAndTime;
}
Instead of manually parsing the JSON line per line (which we could also do) we can have Moshi do the
transformation automatically. We simply define another class EventJson
that directly corresponds
to the JSON structure:
class EventJson {
String title;
String begin_date;
String begin_time;
}
And another class with the appropriate @FromJson
and @ToJson
methods that are telling Moshi how
to convert an EventJson
to an Event
and back. Now, whenever we are asking Moshi to parse a JSON
to an Event
it will first parse it to an EventJson
as an intermediate step. Conversely, to
serialize an Event
Moshi will first create an EventJson
object and then serialize that object as
usual.
class EventJsonAdapter {
@FromJson Event eventFromJson(EventJson eventJson) {
Event event = new Event();
event.title = eventJson.title;
event.beginDateAndTime = eventJson.begin_date + " " + eventJson.begin_time;
return event;
}
@ToJson EventJson eventToJson(Event event) {
EventJson json = new EventJson();
json.title = event.title;
json.begin_date = event.beginDateAndTime.substring(0, 8);
json.begin_time = event.beginDateAndTime.substring(9, 14);
return json;
}
}
Again we register the adapter with Moshi.
Moshi moshi = new Moshi.Builder()
.add(new EventJsonAdapter())
.build();
We can now use Moshi to parse the JSON directly to an Event
.
JsonAdapter<Event> jsonAdapter = moshi.adapter(Event.class);
Event event = jsonAdapter.fromJson(json);
Parse JSON Arrays
Say we have a JSON string of this structure:
[
{
"rank": "4",
"suit": "CLUBS"
},
{
"rank": "A",
"suit": "HEARTS"
}
]
We can now use Moshi to parse the JSON string into a List<Card>
.
String cardsJsonResponse = ...;
Type type = Types.newParameterizedType(List.class, Card.class);
JsonAdapter<List<Card>> adapter = moshi.adapter(type);
List<Card> cards = adapter.fromJson(cardsJsonResponse);
Fails Gracefully
Automatic databinding almost feels like magic. But unlike the black magic that typically accompanies reflection, Moshi is designed to help you out when things go wrong.
JsonDataException: Expected one of [CLUBS, DIAMONDS, HEARTS, SPADES] but was ANCHOR at path $.visible_cards[2].suit
at com.squareup.moshi.JsonAdapters$11.fromJson(JsonAdapters.java:188)
at com.squareup.moshi.JsonAdapters$11.fromJson(JsonAdapters.java:180)
...
Moshi always throws a standard java.io.IOException
if there is an error reading the JSON document,
or if it is malformed. It throws a JsonDataException
if the JSON document is well-formed, but
doesn’t match the expected format.
Built on Okio
Moshi uses Okio for simple and powerful I/O. It’s a fine complement to OkHttp, which can share buffer segments for maximum efficiency.
Borrows from Gson
Moshi uses the same streaming and binding mechanisms as Gson. If you’re a Gson user you’ll find Moshi works similarly. If you try Moshi and don’t love it, you can even migrate to Gson without much violence!
But the two libraries have a few important differences:
- Moshi has fewer built-in type adapters. For example, you need to configure your own date
adapter. Most binding libraries will encode whatever you throw at them. Moshi refuses to
serialize platform types (
java.*
,javax.*
, andandroid.*
) without a user-provided type adapter. This is intended to prevent you from accidentally locking yourself to a specific JDK or Android release. - Moshi is less configurable. There’s no field naming strategy, versioning, instance creators,
or long serialization policy. Instead of naming a field
visibleCards
and using a policy class to convert that tovisible_cards
, Moshi wants you to just name the fieldvisible_cards
as it appears in the JSON. - Moshi doesn’t have a
JsonElement
model. Instead it just uses built-in types likeList
andMap
. - No HTML-safe escaping. Gson encodes
=
as\u003d
by default so that it can be safely encoded in HTML without additional escaping. Moshi encodes it naturally (as=
) and assumes that the HTML encoder – if there is one – will do its job.
Custom field names with @Json
Moshi works best when your JSON objects and Java objects have the same structure. But when they don't, Moshi has annotations to customize data binding.
Use @Json
to specify how Java fields map to JSON names. This is necessary when the JSON name
contains spaces or other characters that aren’t permitted in Java field names. For example, this
JSON has a field name containing a space:
{
"username": "jesse",
"lucky number": 32
}
With @Json
its corresponding Java class is easy:
class Player {
String username;
@Json(name = "lucky number") int luckyNumber;
...
}
Because JSON field names are always defined with their Java fields, Moshi makes it easy to find fields when navigating between Java and JSON.
Alternate type adapters with @JsonQualifier
Use @JsonQualifier
to customize how a type is encoded for some fields without changing its
encoding everywhere. This works similarly to the qualifier annotations in dependency injection
tools like Dagger and Guice.
Here’s a JSON message with two integers and a color:
{
"width": 1024,
"height": 768,
"color": "#ff0000"
}
By convention, Android programs also use int
for colors:
class Rectangle {
int width;
int height;
int color;
}
But if we encoded the above Java class as JSON, the color isn't encoded properly!
{
"width": 1024,
"height": 768,
"color": 16711680
}
The fix is to define a qualifier annotation, itself annotated @JsonQualifier
:
@Retention(RUNTIME)
@JsonQualifier
public @interface HexColor {
}
Next apply this @HexColor
annotation to the appropriate field:
class Rectangle {
int width;
int height;
@HexColor int color;
}
And finally define a type adapter to handle it:
/** Converts strings like #ff0000 to the corresponding color ints. */
class ColorAdapter {
@ToJson String toJson(@HexColor int rgb) {
return String.format("#%06x", rgb);
}
@FromJson @HexColor int fromJson(String rgb) {
return Integer.parseInt(rgb.substring(1), 16);
}
}
Use @JsonQualifier
when you need different JSON encodings for the same type. Most programs
shouldn’t need this @JsonQualifier
, but it’s very handy for those that do.
Omit fields with transient
Some models declare fields that shouldn’t be included in JSON. For example, suppose our blackjack
hand has a total
field with the sum of the cards:
public final class BlackjackHand {
private int total;
...
}
By default, all fields are emitted when encoding JSON, and all fields are accepted when decoding
JSON. Prevent a field from being included by adding Java’s transient
keyword:
public final class BlackjackHand {
private transient int total;
...
}
Transient fields are omitted when writing JSON. When reading JSON, the field is skipped even if the JSON contains a value for the field. Instead it will get a default value.
Default Values & Constructors
When reading JSON that is missing a field, Moshi relies on the the Java or Android runtime to assign the field’s value. Which value it uses depends on whether the class has a no-arguments constructor.
If the class has a no-arguments constructor, Moshi will call that constructor and whatever value
it assigns will be used. For example, because this class has a no-arguments constructor the total
field is initialized to -1
.
public final class BlackjackHand {
private int total = -1;
...
private BlackjackHand() {
}
public BlackjackHand(Card hidden_card, List<Card> visible_cards) {
...
}
}
If the class doesn’t have a no-arguments constructor, Moshi can’t assign the field’s default value,
even if it’s specified in the field declaration. Instead, the field’s default is always 0
for
numbers, false
for booleans, and null
for references. In this example, the default value of
total
is 0
!
public final class BlackjackHand {
private int total = -1;
...
public BlackjackHand(Card hidden_card, List<Card> visible_cards) {
...
}
}
This is surprising and is a potential source of bugs! For this reason consider defining a
no-arguments constructor in classes that you use with Moshi, using @SuppressWarnings("unused")
to
prevent it from being inadvertently deleted later:
public final class BlackjackHand {
private int total = -1;
...
@SuppressWarnings("unused") // Moshi uses this!
private BlackjackHand() {
}
public BlackjackHand(Card hidden_card, List<Card> visible_cards) {
...
}
}
Kotlin Support
Kotlin classes work with Moshi out of the box. However, you need to add the KotlinJsonAdapterFactory
if you want to activate the validation for non-nullable properties. Add it last to allow other installed Kotlin type factories to be used, since factories are called in order.
val moshi = Moshi.Builder()
// Add any other JsonAdapter factories.
.add(KotlinJsonAdapterFactory())
.build()
If you need to annotate your Kotlin classes with an @Json
annotation or otherwise, you need to add KotlinJsonAdapterFactory
as well. In both cases you have to add moshi-kotlin
as dependency (see below).
Download
Download the latest JAR or depend via Maven:
<dependency>
<groupId>com.squareup.moshi</groupId>
<artifactId>moshi</artifactId>
<version>1.5.0</version>
</dependency>
or Gradle:
compile 'com.squareup.moshi:moshi:1.5.0'
and for additional Kotlin support:
<dependency>
<groupId>com.squareup.moshi</groupId>
<artifactId>moshi-kotlin</artifactId>
<version>1.5.0</version>
</dependency>
or Gradle:
compile 'com.squareup.moshi:moshi-kotlin:1.5.0'
Snapshots of the development version are available in Sonatype's snapshots
repository.
ProGuard
If you are using ProGuard you might need to add the following options:
-dontwarn okio.**
-dontwarn javax.annotation.**
-keepclasseswithmembers class * {
@com.squareup.moshi.* <methods>;
}
-keep @com.squareup.moshi.JsonQualifier interface *
Additional rules are needed if you are using the Kotlin artifact:
-keepclassmembers class kotlin.Metadata {
public <methods>;
}
License
Copyright 2015 Square, Inc.
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.