Avro Change Log

Trunk (not yet released)

NEW FEATURES

AVRO-1555. C#: Add support for RPC over HTTP. (Dmitry Kovalev via cutting)

AVRO-834. Java: Data File corruption recovery tool.

(scottcarey and tomwhite)

AVRO-1719: C++: Fix tests with Boost >= 1.59. (Romain Geissler via blue)

OPTIMIZATIONS

IMPROVEMENTS

AVRO-843. C#: Change Visual Studio project files to specify .NET 3.5.

(Dmitry Kovalev via cutting)

AVRO-1585. Java: Deprecate Jackson classes in public API. (tomwhite)

AVRO-1681. Improve generated JavaDocs.

(Charles Gariépy-Ikeson via tomwhite)

AVRO-2109: Reset buffers in case of IOException (gabor)

BUG FIXES

AVRO-1553. Java: MapReduce never uses MapOutputValueSchema (tomwhite)

AVRO-1544. Java: Fix GenericData#validate for unions with null.

(Matthew Hayes via cutting)

AVRO-1489. Java: Avro fails to build with OpenJDK 8. (Ricardo Arguello via

tomwhite)

AVRO-1596. Java: Cannot read past corrupted block in Avro data file.

(tomwhite)

AVRO-1813: Incorrect link to build instructions in Java Getting Started (Pietro Menna via gabor)

AVRO-1688. Ruby test_union(TestIO) is failing. (tomwhite)

AVRO-1782. Ruby: Fix unit test failures in new versions of Ruby. (martinkl)

AVRO-1775. Ruby: Use test-unit gem for running tests. (martinkl)

AVRO-1772. Ruby: load error in rubygem when loading schema normalization.

(blue and martinkl via tomwhite)

AVRO-1729: Ruby: Add LICENSE and NOTICE to ruby gems. (blue)

AVRO-1732: C++: Add LICENSE and NOTICE to binary distribution. (blue)

AVRO-1733: C#: Add LICENSE and NOTICE to binary distribution. (blue)

AVRO-1731: C: Add LICENSE and NOTICE to binary distribution. (blue)

AVRO-1735: Perl: Add LICENSE and NOTICE to distribution. (blue)

AVRO-1736: PHP: Add LICENSE and NOTICE to distribution. (blue)

AVRO-1730: Python 2, 3: Add LICENSE and NOTICE to distribution. (blue)

AVRO-1722: Update root LICENSE.txt and NOTICE.txt. (blue)

AVRO-1728: Java: Add LICENSE and NOTICE files to jars. (blue)

AVRO-1771. Add LICENSE and NOTICE to avro-doc artifact. (blue via tomwhite)

AVRO-1485: Specification says Record field type can be record name but implementation allows any named type.

(Nandor Kollar via gabor)

AVRO-1656. Fix 'How to Contribute' link. (Benjamin Clauss via blue)

AVRO-1883: Java: Fix incompatible schema detection nested in unions.

(Yibing Shi via blue)

AVRO-1407: Java: Fix infinite loop on slow connect in NettyTransceiver.

(Gareth Davis via cutting)

AVRO-2122: Cannot validate schemas with recursive definitions

(Bart via Nandor Kollar)

Avro 1.7.7 (23 July 2014)

NEW FEATURES

AVRO-1315. Java: Schema Validation utilities. (scottcarey and tomwhite)

AVRO-1439. Java: Add AvroMultipleInputs for mapred. (Harsh J via cutting)

AVRO-974. Add a Perl implementation of Avro. (Yann Kerhervé & John Karp)

AVRO-1471. Java: Permit writing generated code in different

character encodings. (Eugene Mustaphin via cutting)

AVRO-1402. Add optional subtypes to specification, initially

including a subtype of bytes and fixed for decimal values.

(tomwhite & Ryan Blue via cutting)

AVRO-1522. Java: Add support for compression codecs to SortedKeyValueFile.

(Steven Willis via cutting)

AVRO-1474. C++ resolvind decoder doesn't work when reader schema

has more fields than writer schema. (thiru with help from Ramana

Suvarapu)

AVRO-1352. Schema for fixed types corrupted when writing out in

JSON format (Steve Roehrs via thiru)

AVRO-1533. Java: In schema resolution, permit conversion between

bytes and string. (cutting)

OPTIMIZATIONS

AVRO-1455. Deep copy does not need to create new instances for primitives.

(tomwhite)

IMPROVEMENTS

AVRO-1441. Java: Improve documentation for Maven configuration.

(Jesse Anderson via cutting)

AVRO-1447. Java: Remove dead code from example in documentation.

(Jesse Anderson via cutting)

AVRO-1449. Java: Optionally validate default values while reading schemas.

(cutting)

AVRO-1472. Java: Clarify parse method in getting started guide.

(Michael Knapp via cutting)

AVRO-1465. Java: Improve the error message when union dispatch fails.

(Gabriel Reid via cutting)

AVRO-1482. In specification, place "null" first in unions as best practice.

(cutting)

AVRO-1476. Java: Remove transient declaration from Schema.Field#position.

(Robert Chu via cutting)

AVRO-1512. Java: Support Thrift unions. (cutting)

AVRO-1535. Java: Make the name .X to refer to X in the null namespace.

This permits aliases to names in the null namespace. (cutting)

AVRO-1536. Ruby: Remove monkeypatching of Enumerable.

(Willem van Bergen via martinkl)

AVRO-1546. Java: Change GenericData.Record#toString() to not

escape forward slashes. (Brandon Forehand via cutting)

BUG FIXES

AVRO-1446. C#: Correctly handle system errors in RPC.

(David Taylor via cutting)

AVRO-1445. Java: Fix protobuf support to correctly handle enums

with default values. (cutting)

AVRO-1436. C#: Fix tests to run multiple times. (David Taylor via cutting)

AVRO-1458. Java: Setting char record field via reflection affects other

fields. (tomwhite)

AVRO-1454. Java: Fix GenericData#toString and AvroAsTextRecordReader

to generate valid Json for NaN and infinities. (cutting)

AVRO-1473. Java: Fix references to names in the empty namespace.

(Gabriel Reid via cutting)

AVRO-1459. Ruby: Fix a typo in Rakefile that breaks 'gem install'.

(Tomas Svarovsky via cutting)

AVRO-1457. Java: Fix Encoder so that offset in non-array-backed

ByteBuffers is not altered when written. (Rob Turner via cutting)

AVRO-1442. Java: Fix ResolvingGrammarGenerator to work with fixed type.

(Jim Pivarski via cutting)

AVRO-1500. Java: Fix bug in handling of Thrift shorts in unions.

(Michael Pershyn via cutting)

AVRO-1513. Perl: Remove test plans from unit test files.

(John Karp via cutting)

AVRO-1462. Perl: Stop spurious serializer warnings about Non-ASCII

decimal characters. (John Karp via cutting)

AVRO-1470. Perl: Fix encoding of boolean values. (John Karp via cutting)

AVRO-1525. Java: ReflectData cannot resolve union with fixed. (tomwhite)

AVRO-1499. Ruby: Fix encoding issue that caused corrupted data files

to be written under Ruby 2.0+. (Willem van Bergen and martinkl)

AVRO-1498. Java: Fix custom encodings to work in reflect without

Unsafe access. (Christopher Mann via cutting)

AVRO-1448. Python3: Fix setup.py installation through PyPI. (taton)

AVRO-1540. C++ doesn't build in Ubuntu. (thiru)

Avro 1.7.6 (15 January 2014)

NEW FEATURES

AVRO-975. C#: Add RPC support. (Mark Lamley via cutting)

AVRO-1388. Java: Add fsync support to DataFileWriter.

(Hari Shreedharan via cutting)

AVRO-1373. Java: Add support for "xz" compresssion codec, using LZMA2.

(Nick White via cutting)

AVRO-1400. Java: Add AvroDefault reflect annotation to specify

default values. (cutting)

AVRO-1397. Java: Binary fragment tools can now read multiple

objects from their input. (Rob Turner via cutting)

AVRO-1396. Java: Enable tojson command-line tool to pretty print output.

(Rob Turner via cutting)

AVRO-1409. Java: Add an API for testing schema compatibility.

(Christophe Taton via cutting)

AVRO-1379. C: avro_file_writer_append_encoded() function.

(Mark Teodoro via dcreager)

AVRO-1414. C++: Add support for deflate-compressed data files.

(Daniel Russel via cutting)

AVRO-1418. Java: Add sync support to AvroMultipleOutputs.

(Deepak Kumar V via cutting)

AVRO-1421. Java: Add an @AvroSchema annotation to reflect. (cutting)

AVRO-1382. Add support for Python3. (Christophe Taton via cutting)

OPTIMIZATIONS

AVRO-1348. Java: Improve UTF-8 to String conversion performance in

Java 6. (cutting)

IMPROVEMENTS

AVRO-1355. Java: Reject schemas with duplicate field

names. (Christophe Taton via cutting)

AVRO-1332. C#: Improve DatumReader performance.

(David McIntosh via cutting)

AVRO-1387. Java: Add DataFileWriter option to inhibit flush per block.

(Hari Shreedharan via cutting)

AVRO-1384. Java: Permit Maven to find imports within project.

(Alexandre Normand via cutting)

AVRO-1397. Java: Improve error message when missing field has no default.

(David Carr via cutting)

AVRO-1398. Increase default sync interval from 16k to 64k.

(Rob Turner via cutting)

AVRO-1234. Java: Permit AvroInputFormat to process files whose

names don't end in .avro. (Dave Beech & Sandy Ryza via cutting)

AVRO-1344. Java: Expose sync interval configuration in mapreduce API.

(Rob Turner via cutting)

AVRO-1406. C++. GenericRecord (GenericDatum, etc.) doesn't support

getters and setters with field name argument.

(Iaroslav Zeigerman via thiru)

AVRO-1063. Ruby: Use multi_json instead of requiring yajl.

(Duke via cutting)

AVRO-1225. Java: Add guide for MapReduce API. (Brock Noland via cutting)

AVRO-1426. Java: Add mapreduce word count example.

(Jesse Anderson via cutting)

AVRO-987. Java: Make Avro OSGI-ready. (Ioannis Canellos via cutting)

AVRO-1427. Java: Improve ResolvingDecoder tests. (Rob Turner via cutting)

AVRO-1432. Java: Reduce javadoc warnings. (cutting)

AVRO-1415. C++ binary encoder and decoder doesn't handle

uninitialzed enums (Ramana Suvarapu via thiru)

AVRO-1434. C#: Fix ObjectCreator to be thread safe.

(David Taylor via cutting)

BUG FIXES

AVRO-1368. Fix SpecificDatumWriter to, when writing a string

schema, not silently convert any object to a string.

(Christophe Taton via cutting)

AVRO-1374. Java: Fix compilation against Hadoop 2.1.

(Julian Zhou via cutting)

AVRO-1366. Fix specification's description of metadata format.

(cutting)

AVRO-1377. Java: Fix a bug in Schema#toString() when a namespaced

enum or fixed is defined within an un-namespaced record.

(Graham Sanderson via cutting)

AVRO-1399. Java: Fix a test within TestAvroKeyOutputFormat.

(Rob Turner via cutting)

AVRO-1410. Explicit version specification in pom prevents dependency

management. (Eric Sammer via tomwhite)

AVRO-1358. C: Hide symbols that aren't in the public API. (dcreager)

AVRO-1237. C: Bounds-check union discriminant when reading a data file.

(Michael Cooper via dcreager)

AVRO-1369. C: Use correct byte-swapping functions on Mac OS X.

(thinker0 via dcreager)

AVRO-1405. C: Check for end-of-file correctly.

(Mika Ristimaki via dcreager)

AVRO-1424. ValidatingDecoder hangs on large schema (thiru)

AVRO-1433. Java: Fix compiler to not drop aliases when StringType

is String. (cutting)

Avro 1.7.5 (12 August 2013)

NEW FEATURES

AVRO-1307. Java: Add 'cat' tool to append and sample data files.

(Vincenz Priesnitz via cutting)

AVRO-1274. Java: Add a schema builder API. (tomwhite)

AVRO-1319. Java: Add command line tools to generate random data

files and to convert Avro to Trevni. (cutting)

AVRO-823: C#: Add data file support. (David McIntosh via cutting)

AVRO-896. C: Snappy compression codec. (Grisha Trubetskoy via dcreager)

AVRO-1337. Java: Add a command line tool to generate schema files

from a protocol. (Bertrand Dechoux via cutting)

AVRO-1341. Java: Add reflection annotations @AvroName, @AvroIgnore,

@AvroMeta, @AvroAlias and @AvroEncode. (Vincenz Priesnitz via cutting)

AVRO-1353. Java: Permit specification of data model (generic,

specific, reflect, or other) in mapreduce job configuration.

(Marshall Bockrath-Vandegrift via cutting)

IMPROVEMENTS

AVRO-1260. Ruby: Improve read performance. (Martin Kleppmann via cutting)

AVRO-1267. Java: Permit dashes in IDL property names. (cutting)

AVRO-1272. Ruby: Improve schema namespace handling.

(Martin Kleppmann via cutting)

AVRO-1268. Java: Extend support for stringables from reflect to

specific. String schemas in generated classes now support the

"java-class" and "java-key-class" properties. The built-in Java

types BigDecimal, BigInteger, URI, URL, and File can now be fields

in generated classes. (Alexandre Normand and cutting)

AVRO-1259. Java: Improve Trevni's encoding of sparse columns.

(cutting)

AVRO-1287. Add data file with deflate codec to the interoperability

test suite. (martinkl)

AVRO-1288. Ruby: Add support for deflate codec in data files.

(martinkl)

AVRO-867. Java: Enable command-line tools to read data files from

any Hadoop FileSystem implementation. (Vincenz Priesnitz via cutting)

AVRO-1299. Java: SpecificRecordBase implements GenericRecord.

(Christophe Taton via cutting)

AVRO-1282. Java: Use sun.misc.Unsafe to improve Reflect API Performance.

(Leo Romanoff via scottcarey)

AVRO-1313. Java: Add system property avro.disable.unsafe for disabling

use of sun.misc.Unsafe. (scottcarey)

AVRO-1327. Java: Make GenericEnumSymbol implement Comparable. (cutting)

AVRO-1314. Java: add @threadSafe annotation to maven plugins.

(scottcarey)

AVRO-1334. Java: Upgrade snappy-java dependency to 1.0.5

(scottcarey)

AVRO-1238. C: EOF detection in avro_file_reader_read_value.

(Michael Cooper via dcreager)

AVRO-1324. C: Handle namespaces in schema parsing.

(Ben Walsh via dcreager)

AVRO-1290. Handling NaN and positive and negative infinities in

C++ Json (Daniel Russel via thiru)

AVRO-1351. Extend SortedKeyValueFile to support data models

besides generic. (cutting)

AVRO-1261. Clarify in documentation that generated no-arg

constructors do not use default values from schema. (cutting)

AVRO-1297. NettyTransceiver: Provide overloaded

close(boolean awaitCompletion). (jbaldassari)

AVRO-1279. C: Treat missing codec in data files as null codec.

(Carl Steinbach via dcreager)

AVRO-1325. Java: Enhanced Schema Builder API. (scottcarey)

BUG FIXES

AVRO-1296. Python: Fix schemas retrieved from protocol types

to not ignore namespaces. (Jeremy Kahn via philz)

AVRO-1266. Java: Fix mapred.AvroMultipleOutputs to support multiple

different schemas. (Ashish Nagavaram via martinkl)

AVRO-1295. Java: Fix printing of a non-null namespace within a

null namespace. (cutting)

AVRO-1300. Java: Fix generated copy constructors to copy field

values. (Christophe Taton via cutting)

AVRO-1309. Java: Fix nested protobuf enums. (cutting)

AVRO-1308. Java: Fix repeated protobuf messages & enums.

(Steve Zesch & cutting)

AVRO-1306. Java mapred: Fix incorrect documentation for combiners.

(Mina Naguib via martinkl)

AVRO-1320. Java: Fix Trevni to correctly read unions and specific enums.

(cutting)

AVRO-1326. Java: Fix bug in BZip2 codec. (cutting)

AVRO-1322. Java: Add Hadoop version classifier to trevni-avro

Maven artifacts. (massie)

AVRO-1316. Java: Fix compiler to split long schema string

constants so javac can compile them. (Jeremy Kahn via cutting)

AVRO-1331. Java: Fix schema-parsing incompatibility from AVRO-1295.

(cutting)

AVRO-1181. compileJsonSchemaFromString(std::string) declared in

Compiler.hh but not defined (Daniel Russel via thiru)

AVRO-1346. C++: schema parser cannot parse verbose primitive types

(Skye Wanderman-Milne via thiru)

AVRO-1171. Avro C++ Json Decoder: Double cannot be decoded (Sam

Overend via thiru)

AVRO-1293. Java: Fix potential deadlock in NettyTransceiver.

(James Baldassari via cutting)

AVRO-1292. Java: Fix potential client blocking in NettyTransceiver.

(James Baldassari via cutting)

AVRO-1144. Java: Deadlock with FSInput and Hadoop NativeS3FileSystem.

(scottcarey)

AVRO-1356. Java: Fix AvroMultipleOutputs for map-only jobs.

(Alan Paulsen via cutting)

Avro 1.7.4 (22 February 2013)

NEW FEATURES

AVRO-1248. Avro Tool to dump protocol of a remote RPC Service

(Gareth Davis via philz)

AVRO-1229. Add support for booleans to Trevni. (cutting)

AVRO-1250. Add a command-line tool to concatenate data files.

(Nick White via cutting)

AVRO-1243. Java: Add support for bzip2 file compression and

translate Hadoop job compression options. (Ted Malaska via cutting)

AVRO-1253. Java: Add support for bzip2 file compression to Trevni.

(Ted Malaska via cutting)

AVRO-1254. Java: Add support for new mapreduce APIs to Trevni.

(Ted Malaska via cutting)

IMPROVEMENTS

AVRO-1211. Add MR guide to documentation. (Skye Wanderman-Milne via

tomwhite)

AVRO-1221. Java: Fix TestSaslDigestMd5 to pass on IBM JVM.

(Rodrigo Trujillo via cutting)

AVRO-1008. Java: Improve support for forcing connection

handshakes. (jbaldassari & cutting)

AVRO-970. Java: Make Codec API public. (Rui Pereira via cutting)

AVRO-1223. Java: Add a static method to generated classes that

returns its schema, getClassSchema(). (cutting)

AVRO-1232. Java: Add a toString() method to AvroWrapper so that it

works with TextOutputFormat. (Garrett Wu via cutting)

AVRO-1241. Java: Optimize Trevni string input. (Joseph Adler via cutting)

AVRO-1198. Java: Improve error message for malformed data. (cutting)

AVRO-1252. Java: Add a '-string' option to compiler command line

to cause java.lang.String to be used instead of Utf8. (cutting)

AVRO-1255. Python: Make 'names' parameter optional in to_json methods.

(Jeremy Kahn via cutting)

AVRO-1251. Java: Add TestNettyServerWithCompression, illustrating

how one can add compression to Avro Netty-based RPC.

(Ted Malaska via cutting)

BUG FIXES

AVRO-1231. Java: Fix Trevni shredder to work on non-recursive

schemas with multiple references. (Mark Wagner via cutting)

AVRO-1230. avro-mapred-1.7.3-hadoop1.jar does not work with

Hadoop 1. (tomwhite)

AVRO-1233. Java: Fix InputBuffer's constructor to use the

specified initial position. (Mark Wagner via cutting)

AVRO-1227. Java: Large ByteBuffers can corrupt output. (cutting)

AVRO-1228. Java: Fix Trevni to use default values for missing Avro fields.

(cutting)

AVRO-1240. Java: Fix SpecificDatumReader(Class) constructor to use

correct ClassLoader. (cutting)

AVRO-1242. Java: Fix AvroTrevniOutputFormat to correctly get file

metadata from JobConf. (Ted Malaska via cutting)

AVRO-1220. Java: Fix a deadlock when reading by replacing parser

symbol constructors with factory methods. (cutting)

AVRO-1249. Java: Fix DataFileWriter#close() to not throw an

exception when called twice. (E. Sammer via cutting)

AVRO-1247. Java: Fix Requestor and Responder implementations to

use correct ClassLoader. (cutting)

AVRO-1215. Java: Fix AvroMultipleOutputs when specifying baseOutputPath.

(Ashish Nagavaram via cutting)

AVRO-1257. Ruby: Fix UTF-8 encoding in Ruby 1.9.

(Martin Kleppmann via cutting)

AVRO-1258. Ruby: Fix handing of RPC errors. (Martin Kleppmann via cutting)

Avro 1.7.3 (6 December 2012)

NEW FEATURES

AVRO-485. JavaScript: Add validator. (Quinn Slack via cutting)

AVRO-1157. Java: Extend schema and protocol property support from

string-only to full JSON. (cutting)

AVRO-1186. Java: Extend specific compiler to emit Java annotations

on interfaces, classes, fields and methods for the property

"javaAnnotation". The value of the property may either be a

string or a JSON array of strings in order to emit multiple

annotations. (cutting)

AVRO-1188. Java: Permit external schema imports for schemas in

Maven plugin. (Sharmarke Aden via tomwhite)

AVRO-1202. Java & Python: Add "Getting Started" guides.

(Skye Wanderman-Milne via cutting)

AVRO-1205. Java: Add stereotype annotation to generated classes.

All classes generated by the specific compiler now have the

annotation org.apache.avro.specific.AvroGenerated.

(Sharmarke Aden via cutting)

AVRO-988. Java: Add option to make fields in generated classes

private, public, or public & deprecated. This is specified with

the "fieldVisibility" option in Maven and is public_deprecated by

default for compatibility. (Jeff Kolesky via cutting)

AVRO-1209. Java: Add option to generate immutable classes, without

setter methods. This is specified with the "createSetters"

boolean option in Maven and is true by default for compatibility.

(Jeff Kolesky via cutting)

IMPROVEMENTS

AVRO-1169. Java: Reduce memory footprint of resolver.

(Hernan Otero via cutting)

AVRO-1183. Java: Provide a better error message when the schema

for a Pair cannot be inferred. (cutting)

AVRO-1207. Java: Add tests for Maven plugins. (Sharmarke Aden via cutting)

AVRO-1210. Java: Fix mistakes in AvroMultipleOutputs error messages.

(Dave Beech via cutting)

AVRO-1178. Java: Fix typos in parsing document.

(Martin Kleppmann via cutting)

AVRO-1089. C: Remove performance penalty when using resolved writer with

arrays. (dcreager)

BUG FIXES

AVRO-1171. Java: Don't call configure() twice on mappers & reducers.

(Dave Beech via cutting)

AVRO-1170. Java: Avro's new mapreduce APIs don't work with Hadoop 2.

(tomwhite)

AVRO-1197. Java: Expose mapreduce tests so that 'maven install'

works correctly. (Mike Percy via cutting)

AVRO-1200. DatumWriter can write malformed data if collection is

modified during write. (tomwhite)

AVRO-1199. Java: Fix SortedKeyValueFile to copy the key used to

compare against next. Also improve GenericData#deepCopy() to be

generic, so that its return type matches its parameter type. (cutting)

AVRO-1201. Java: Fix GenericData#toString() to generate valid JSON for

enum values. (Sharmarke Aden via cutting)

AVRO-1206. Ruby: Fix UTF-8 handling in Ruby 1.9.

(Nicolas Fouché via cutting)

AVRO-1177. Ruby: Fix RPC to only send handshake for first request

over a connection. (Georg Franz via cutting)

AVRO-1175. Java: Clear thread local reference in BinaryData#compare().

(cutting)

AVRO-1163. C: Fix a memory leak in avro_fixed_private(). (Maxim

Pugachev via brucem)

AVRO-1174. C: Fix Windows build. (Stefan Langer via brucem)

Avro 1.7.2 (20 October 2012)

NEW FEATURES

AVRO-806. Add specification of the Trevni columnar file format

and a Java implementation of it. (cutting)

IMPROVEMENTS

AVRO-1146. Java: Serialize several built-in Java classes as

strings, including BigDecimal, BigInteger, URI, URL, Date and

File. (Alexandre Normand and cutting)

AVRO-1147. Java: Permit stringable map keys in reflect.

(Alexandre Normand)

AVRO-1151. Netty Avro server should expose the number of connections

currently open. (Hari Shreedharan via tomwhite)

AVRO-1149. Java: Add a constructor to generated classes with all

fields as parameters. (Gabriel Reid via cutting)

AVRO-1138. C: Add function for opening existing data file with non-default

block size. (Maxim Pugachev via dcreager)

AVRO-1129. C: Detect when avro_schema_decref frees schema.

(Maxim Pugachev via dcreager)

AVRO-1162. Java: Extend AvroKeyValueOutputFormat to support

reflection. (Alexandre Normand via cutting)

AVRO-1142. Clarify Snappy block compression in specification. (cutting)

BUG FIXES

AVRO-1128. Java: Fix SpecificRecordBase#equals() to work for

records that contain maps. (cutting)

AVRO-1131. Generated build makefiles for MSYS/MinGW use Visual

Studio compiler flags (Laurent Moss via thiru)

AVRO-1103. Java: Fix SpecificData and mapreduce to use correct

classloader. (cutting)

AVRO-1135. Avro C++ fails to build on Mac. (thiru)

AVRO-1140. Buffer.hh includes Config.hh without "../" (Jan van der

Lugt via thiru)

AVRO-1141. Avro data files are created without O_TRUNC (Martin

Nagy via thiru)

AVRO-1143. avrogencpp generates $Undefined$ for some union types (thiru)

AVRO-1152. Java: Fix TestTraceSingletons for Java 7. (cutting)

AVRO-1111. Malformed data can cause OutOfMemoryError in Avro IPC.

(Mike Percy via tomwhite)

AVRO-1155. Stringable Date test in TestReflect fails if timezone doesn't

match locale's default. Removed Date from built-in stringables. (tomwhite)

AVRO-851. Java: Fix a bug in GenericData#toString() when escaping

characters. (Jeff Mesnil via cutting)

AVRO-1154. Java: Fix NettyTransciever to not hang when the server

is stopped. (Karel Vervaeke & Bruno Dumon via cutting)

AVRO-1158. C: Fixed infinite loop in deflate decompression codec.

(Lucas Martin-King via dcreager)

AVRO-1159. C: Check union discriminants in avro_value_read.

(Lucas Martin-King via dcreager)

AVRO-1160. C: Better error reporting in avrocat. (Lucas Martin-King

via dcreager)

AVRO-1166. Java: Fix bug in SpecificData.getSchema(Map). (George

Fletcher via cutting)

AVRO-1150. Java: Fix tests to create all temporary files in target

directories. (Gabriel Reid via cutting)

AVRO-1164. C: Clean up valgrind warnings in test_avro_schema test case.

(Vivek Nadkarni via dcreager)

AVRO-1165. C: Fix memory leak in generic value implementations involving

LINK schemas. (Vivek Nadkarni via dcreager)

AVRO-1161. C: Fix memory leak in avro{append,cat,mod,pipe} (dcreager)

Avro 1.7.1 (16 July 2012)

NEW FEATURES

AVRO-1106. Java: Add AvroMultipleOutputs for newer mapreduce API.

(Ashish Nagavaram via cutting)

AVRO-1112. Java: Add support for Snappy codec to newer mapreduce API.

(Matt Mead via cutting)

AVRO-1108. Java: Add support for reflect API to newer mapreduce API.

(cutting)

AVRO-1104. C: avroappend utility. (Lucas Martin-King via dcreager)

AVRO-1117. C: avro_file_writer_create_with_codec_fp and

avro_file_writer_create_with_fp functions, with should_close parameter.

(Lucas Martin-King via dcreager)

IMPROVEMENTS

AVRO-1120. Let AvroMultipleOutput jobs use multiple schemas with

map-only jobs. (Ashish Nagavaram via cutting)

AVRO-1119. Java: Permit NettyServer to be used with SSL.

(Sebastian Ortega via cutting)

AVRO-1125. Java: Remove un-needed warning about reflect API. (cutting)

BUG FIXES

AVRO-1114. Java: Update license headers for new mapreduce code. (cutting)

AVRO-1069. Java: Fix HttpTransceiver to close streams. (cutting)

AVRO-1115. C: Fix crash error in codec cleanup code. (Maxim Pugachev via

dcreager)

AVRO-1116. C++ code crashes on Data files with no data. (thiru)

AVRO-1109. CSharp specific fails on multidimensional arrays.

(Mark Farnan via thiru)

AVRO-1153. Java: Fix reflect to be able to write unions that

contain stringable schemas. (Alexandre Normand via cutting)

Avro 1.7.0 (11 June 2012)

NEW FEATURES

AVRO-301. Handle non-reserved properties appropriately in the Python

implementation. (Macrio Silva via tebeka)

AVRO-300. Support "doc" field in schemas in Python implementation.

(Harsh J via tebeka)

AVRO-1006. Add schema fingerprinting to specification and Java.

(Raymie Stata via cutting)

AVRO-593. Java: Add support for Hadoop's newer mapreduce API.

(Garrett Wu via cutting)

AVRO-1052. Java: Add AvroMultipleOutputFormat, to permit splitting

mapreduce output to multiple locations. (Ashish Nagavaram via cutting)

IMPROVEMENTS

AVRO-1060. Java: Upgrade Netty to version 3.4.0. (Karthik K via cutting)

AVRO-1068. Avro Java does not build on recent Eclipse versions

with m2eclipse (thiru)

AVRO-551. C: Now compiles on Win32, using Visual Studio C++ 2008.

(Vivek Nadkarni via dcreager)

AVRO-1075. Add some Eclipse stuff to .gitignore. (Karthik K via cutting)

AVRO-1085. Fingerprinting for C#. (Eric Hauser via thiru)

AVRO-1079. C++ Generator, improve include guard generation. (thiru)

AVRO-1062. Java: Remove use of java.rmi.server.UID so things work

on Android. (Kevin Zhao via cutting)

AVRO-1090. Java: Permit appending to files besides java.io.File,

e.g., files in HDFS. (cutting)

AVRO-1074. Java: Optimize Utf8#length() and #toString() to not

allocate a String when the length is zero. (cutting)

AVRO-1050. PHP: Optimize memory use by string append. (A B via cutting)

AVRO-1095. C++ compiler warns about control reaching end of

doAdavance (in JsonIO.cc) which returns something other than

void. (thiru)

AVRO-1026. Add namespace support to C++. (Keh-Li Sheng via thiru)

AVRO-1097. Fix BinaryDecoder so that EOFException is thrown

instead of a generic IOException when reading ints and longs past

the end of file. (thiru & cutting)

AVRO-1098: CSharp: Fix compilation to work under older versions of Mono.

(cutting)

BUG FIXES

AVRO-1045. Java: Fix a bug in GenericData#deepCopy() of ByteBuffer values.

(cutting)

AVRO-1055. Race condition in Java fingerprinting code (thiru)

AVRO-954. Typo in JsonCodec.cc (Nebojsa Sabovic via thiru)

AVRO-1045. C: Use less stack space in avro_file_writer_create (dcreager)

AVRO-1070. AvroSequenceFileOutputFormat is in wrong package. (thiru)

AVRO-1080. JsonIO.cc should allow \u escape sequence in

string. (Keh-Li Sheng via thiru)

AVRO-1066. ArrayIndexOutOfBoundsException in ParsingEncoder when

trying to use a json encoder to serialize a deep object

graph. (thiru)

AVRO-1065. NodeRecord::isValid() treats records with no fields as

invalid. (thiru)

AVRO-1081. Java: Fix to be able to write ByteBuffers that have no

backing array. Also fix reflection to correctly read ByteBuffer

fields. (cutting)

AVRO-1046. Java: Fix ReflectDatumReader to be able to read generic

or specific arrays. (cutting)

AVRO-1056. Java: Fix reflect to correctly handle unions containing

maps. (Kevin Zhao via cutting)

AVRO-1076. Java: Fix Protocol#equals() to consider

properties. (Karthik K via cutting)

AVRO-1094. Java: Fix specific compiler to better support

non-default templates. (Ed Kohlwey via cutting)

AVRO-1082. C: Avoid leaking open FILE objects.

(Pugachev Maxim via dcreager)

AVRO-1096. C: Don't set default CMAKE_OSX_ARCHITECTURES. (dcreager)

AVRO-1084. C: Fix reference counting in file_reader and file_writer.

(Pugachev Maxim via dcreager)

AVRO-1083. C: Fix multiple memory leaks. (Pugachev Maxim via dcreager)

AVRO-1086. C: Fix possible crash bug in default codec initialization.

(Pugachev Maxim via dcreager)

AVRO-1096. C: Describe CMAKE_OSX_ARCHITECTURES in installation

instructions. (dcreager)

AVRO-1088. C: Performance tests for arrays and schema resolution.

(Vivek Nadkarni via dcreager)

AVRO-1092. C: Error management code can be defined in a thread-safe

manner. (Pugachev Maxim and Vivek Nadkarni via dcreager)

AVRO-1091. C: Helper scripts for calling CMake.

(Vivek Nadkarni via dcreager)

AVRO-1087. C: avro_file_writer_open() and appending Avro values

works correctly. (Pugachev Maxim via dcreager)

AVRO-1102. C: Remove memory leak in avro_string(). (Maxim Pugachev via

dcreager)

AVRO-1099. Java: Fix JsonDecoder to permit floats and doubles to

be read from JSON values without decimal points, and for ints and

longs to be read from JSON values with decimal points. (cutting)

Avro 1.6.3 (5 March 2012)

AVRO-1077. Missing 'inline' for union set function. (thiru)

AVRO-1078. ostreamOutputStream declaration missing in C++ API (thiru)

AVRO-1051. Java: Fix specific RPC so that method is found when

parameters are a union of a primitive and null.

(Hamed Asghari via cutting)

AVRO-1049. Java: Fix GenericData.Record#equals() to correctly

compare schemas and fix Schema#equals() to consider order. (cutting)

IMPROVEMENTS

AVRO-1030. Fix a broken link in the documentation.

BUG FIXES

AVRO-1037. Problems using Avro 1.6.2 with Hadoop (CDH3 or 1.0) (scottcarey)

AVRO-1036. Fix a regression in IDL imports created by AVRO-971.

(George Fletcher & cutting)

AVRO-1031. C: Test cases made too many assumptions about memcmp

result. (dcreager)

AVRO-1033. C: Fixed x86 assembly implementation of atomic reference

counting primitives. (Vivek Nadkarni via dcreager)

AVRO-1034. C: Resolved readers initialize complex array values

correctly. (Vivek Nadkarni via dcreager)

AVRO-1038. C: Require GCC 4.5.0 to use GCC atomic instrinsics.

(Vivek Nadkarni via dcreager)

AVRO-1039. C: Don't use nonexistent codecs in test cases. (dcreager)

AVRO-1041. Java: Fix Utf8 to reuse array in more cases.

(Dave Irving via cutting)

AVRO-1027. Java: Fix deadlock in NettyTransceiver.

(Simon Wilkinson via cutting)

Avro 1.6.2 (13 February 2012)

NEW FEATURES

AVRO-854. Python: Permit DataFileWriter and DataFileReader to be

used as context managers in "with" statements. (Harsh J via cutting)

AVRO-986. C: avromod utility for modifying structural properties of

an Avro data file. (dcreager)

IMPROVEMENTS

AVRO-963. Java: Permit compiler template directory to be

overridden by Maven plugins. (George Fletcher via cutting)

AVRO-953. Python: Permit users to override HTTP path in RPC.

(Craig Landry via cutting)