I’ve been coding an simple RESTful “ip to country” conversion service. I’ve decided to put it up to appengine – so that everybody may use it freely even if I’d change my server etc… And if looked quite nice the first day – buw when I got to do some “real stuff” app engine started to get in my way, here’s a quick rundown of the problems I’ve found with appengine:

1. I need to download and update the ip<->country database every few days. I’d use an GZIPInputStream and BufferedReader to get the file I was interested in and update the database. Did appengine allow me to use such an simple aparoach?
   1. pro: appengine provides a very nice cron-like mechanism. So I just had to create an cron.xml in WEB-INF and this part was ready to go! This was in fact easier and more fun than in classic Spring + Open Symphony Quartz.
   2. con:I checked if this tactic was OK with the JRE whilelist and checked the Quotas – http://code.google.com/appengine/docs/quotas.html#UrlFetch, “seems ok” – I thought – “nothing about per connection limits, only daily quotas.”. After writing the code, I discovered that even though on the main quota page there was no word about per connection limits, in fact there are such quotas, but a little more hidden: http://code.google.com/appengine/docs/java/urlfetch/overview.html Max request/response sizes are capped at exactly 1MB.
      As my gzipped file is around 1.1MB, appengine killed my simple idea… I’d have to split the file into separate ones – on another server, and then fetch the separated files onto appengine.
   3. con:The mentione CRON mechanism is quite funny. You don’t call methods but URLs – and they are normally called as if one would launch them from the browser – thus, traffic and “max time” quotas do count there as well. So rather than calling an method, as you’d do with OpenSymphony – you create an Servlet that does all the work. This may me both good, and bad… You cound do all the CRON stuff by hand if it got out of sync etc… I didn’t really like it, and as mentioned… When doing my “big batch database update” the servlet would simply timeout…
2. Let’s talk about the dataStore. As you all probably know… AppEngine does not provide and “database” per se. It’s not relational and has quite some limitations. BUT! That’s quite ok, as it’s very quick and very very scalable! And most of the time… Do you really need all those fancy relations? ;-) It was an ideal place to hold my super simple data: “ip region = country” mapping in a persistent way. “Another nice thing on appengine for this application I’m going to write.” – I thought. Was I right?
   1. pro/con: Not really… I used JPA but JDO (which is prefered by appengine from what I’ve seen) also works nice on GAE. The setup did run quite ok while I was running tests on my local machine. Deployment is also an breeze and I didn’t have to use any complicated dependencies to get it running – “yay, no maven!”. You just have to enchance the classes you want to make persistent (just as hibernate does).
   2. con:The problems started when I wanted to clear my datastore. Nothing easier than that, right…? “delete from BlaBla” and we’re done. Yeah, but not on GAE. As even the “max rows a query touches” are limited – to 500. So there I am, with my 100.000 rows, and I have to delete them in 500 rows per query… Of course I can’t call this in an loop – as the timeout quota would get in my way and kill the app.From what I’ve seen, people do solve this using a CRON task that calls this “clearDatabase” servlet until it’s  done – ugh, not a nice solution but I can’t think of any other solution :\
   3. con:The only query I need to do in this app is basically:

      SELECT range FROM RemoteIpData as range
                   WHERE range.ipFrom <= ?1
                     AND range.ipTo >= ?2
      #and this would always return 1 entry!
      

      And guess what… AppEngine does not support multiple “less/more than” operands in one query! If you think hard about what BigTable is, it does make some sense. More information about “GQL” can be found here: http://code.google.com/appengine/docs/python/datastore/gqlreference.html All the restrictions about the Queries you can do are documented here – some are really counter intuitive when you come from an RDBMS enviroment… Ah well ;-) Oh, and yet another great link about GAE limitations.

      Having this limitation, really sucks for my normally “super simple query”, and I’d have to change the data structure somehow or do some awful 2 queries and then combine them in Java (omg teh terrorr… :<). So, while developing on appengine, keep in ming – simple things might turn out quite complicated due to the nature of BigTable. If you know all the limitations when designing the system and not while finishing it, you’ll be a happier man… ;-)

   4. neutral: Primary keys can’t be Integers etc, as AppEngine uses it’s own “Key” type. :-)
3. Having that all said. Appengine’s administration panel is quite ok. And the not-so-newly-added log search etc are really fine tools. Something an plain old tomcat can not offer. On the other hand, the limitations can really be a deal breaker! My app was really fairly simple, and yet appengines quotas managed to really get in my way. Keep this in mind while thinking about using it. You may also try Amazon’s cloud or CloudForce from SalesForce etc… They all do offer a quite less restrictive enviroment.
4. If you’re interested, deployment does take about 5-7 minutes before the new version is visible on the web – so don’t panic if you’re still seeing the old version after deploying the new one.
5. My opinion about GAE…? (semi serious ;-))

“Screw you clouds, I’m going /home!”
(intended southpark pun)

I’ll finish this project using my ol’ pal, Tomcat6 which I’ve already got running for netbeans.edu.pl (but that was an grails app).

I’ve also decided to use Spring, which I didn’t really need on appengine – as the only thing I was doing was so small that all the logic was around 10 lines in the servlets… But if using hibernate and all the other “real” JEE stuff, I felt I’d need to “do this right” so I’ve decided for Spring 3 and Maven2… I’ll try to build this project from gradle soon too!

ALSO! If interested in an more experienced programmers view on appengine (I’m still a novice), go and read this blog post about GAE on Sławek Sobótkas blog. All in all we seem to agree that the limitations can be an pain in the a… ;-)

The source for the appengine version is on my github account. I’m porting it to an plain old tomcat environment and will post this version there too when it’s ready to run (tomcat deployment is somehow hell with such apps for me… Any tips are really welcome :-))

Hi there, below is the (horribly trashy and chaotic – as it was hacked up in about 2/3 hours) source for my Google Gmail Contextual Gadget.

It extends Gmail by parsing all links passed in an email, and if an github commit link is found it displays the diff for this commit. With coloring etc – just as github would. It’s really fairly easy to get this kind of things going, and if your working with Google Apps (using gmail in your domain etc) you can use this, and many more gadgets (though I didn’t find much of them really useful – that’s why I’ve written this one).

The source can be downloaded, and fixed (which I hopefuly will have time to do! As it’s a mess, let’s say, “proof of concept”): http://github.com/ktoso/GitHubDiff (It’s on the MIT license).

Read the full story to see instalation instructions as well as documentation links…

HOW TO INSTALL:
It can be installed by your own into gmail, if you’re running on Google Apps -just by creating an new Application on the Market and then adding it to your Account. If you’d like me to polish and publish this to the Google Enterprise Market – you’d have to fund me the publish fee, 100$… ;-)

DOCUMENTATION:
Contextual Gadgets: http://code.google.com/apis/gmail/gadgets/contextual/

jQuery – getJSON: http://api.jquery.com/jQuery.getJSON/
GitHub API – http://develop.github.com/p/commits.html

LICENSE:
The source is MIT licensed, feel free to use it as a base for your own projects etc. It’s nothing particularly well written etc ;-)

Enjoy github in your gmail – two amazing webapps in one… :-)

Anyways, I’m using github most of the time, but now I’d like to hava a non public repository (yet remote) for some small project. I’ve been commiting to a local git instance from the begining of this project so just pushing it into a new repo will be really simple.

I wanted to have som easy to administer localozed git to serve hit hosting for my friends etc. So this is how I did it:

On server:

Now we can do all the administration without being logged in into our server – just by using git!

You can then just pull/clone this repo:

git clone git://stratos/bla.git

Yeah, this post isn't much of an discovery - yet I wanted to show you how SIMPLE and SCALABLE a simple git repository can be. For mor information about git and gitosis see: a simple google search

Zen points directly to the human heart,
see into your nature and become Buddha.
- Hakuin Ekaku (1685–1768)

For those who don’t know about zen coding (where have you been guys?) here’s a little sample:

Instead of writing:
<form class="form-comment" id="comment">
<fieldset>
<input id="myid" name="name" type="" />
<input onclick="hideMe()" type="" />
</fieldset>
</form>

You write

form.form-comment#comment>fieldset>input#myid[name=name]>input[onclick=hideMe()]

and hit [TAB].

To understand zen, you must understand yourself. (yet I also strongly suggest watching this video)

Links:
http://confluence.jetbrains.net/display/IDEADEV/Maia+EAP – IntelliJ IDEA Early Access Program
http://code.google.com/p/zen-coding/ – zen coding website

Tkat said, if you have 30min to spare, or just want to play it in the background while working as I did: http://itspice.net/cms/it-news/podcast/what-next-in-java-web-development-tim-bray-podcast

• The recodring is from 2009 – back ind the days with Sun still existent ;-)
• Weird that they didn’t know about Symfony – the very awesome and scalable PHP Framework.

Łukasz Lenart – “Google AppEngine – chmura na Ja(v)wie”

Łukasz, from the Warsaw JUG, was talking about Google’s AppEngine – it’s baisically Just Another Servlet Container but since it’s in a Cloud, it’s (potentially) easy to scale an application deployed on it… But the biggest benefit of deploying to the AppEngine is in my opinion: free java hosting. If our app doesn’t exceed some specyfic quotas (most importantly is smaller than 500MB – concerning the Data/Blob Stores) we don’t have to pay Google for the hosting. You could call this a free cloud for beginners, and if your app gets bigger, you’re kinda trapped in this clound, and then have to pay google some fees for the extra bandwidth etc.

Sadly not everything is “allowed” and we are restricted by a Java Class WhiteList. Also, there is no Relational Database available for us on the AppEngine – instead we can use the “DataStore” with GQL (or JDO or JPA) and for files there is the (now in “beta” status) BlobStore – the name explaing everything I guess… ;-) Another “restriction” would be not being able to access the filesystem. I can only guess why, but it would seem that this would make the AppEngine easier to scale… (sadly I’m not an AppEngine Developer so that’s just my wild guess). Ok, but why did I put the word “restriction” in quotes? Because I don’t think this “restriction” is that much of a hurdle… We can always use resources from inside our WAR by using Class.getResource() (I didn’t test this on the AE, but it sounds plausible and should work) and for uploaded files there’s the BlobStore. There are some more “services” like simplified threading (normal java threads wouldn’t be easy to controll by the AppEngine I guess, so that’s why they introducet this option) and some more – there’s XMPP, Mailing support etc…

All in all, I wasn’t a big fan of cloud’s to begin with, and even though the AppEngine seems like a nice place to Deploy, I’m not really convinced to go with it. The presentation was all right and I did learn some thing’s about the AE I didn’t know before – and the “show what doesn’t work and not what does work out of the box” apparoch Łukasz took, was really nice much more interesting than just “click… yay it’s working” – as it doesn’t go like that IRL most of the time…
That said, I’ll stick with a Tomcat server for my GWT-Crossword.

Oh, and the slides are available here and the source code of the demo (“Struts2 on AppEngine”) he showed can be pulled from mercurial by:

hg clone https://lukaszlenart-wjug.googlecode.com/hg/ gruuf-done

Miroslav Kopecky – “Outlook to Android Application Development” (yup, another Google product today)

I own an Android powered (and there for Linux powered :-)) HTC Hero since two days, but am not “new” in the Android API as I’ve been reading quite a bit about it since it was announced alongside with the G1 (or was it announced before the phone..? hmm…). Mirek’s presentation was an introduction into the Android Platform, or as we noticed “Framework”, as coding Android apps feel’s very much like using an framework (yes, every API is more or less something like a framework, but the “feel” here is really framework-ish, with lot’s of method overriding etc.). After some introduction into an Android Apps structure, Mirek went on and showed 4 application demos. They were using simple layouting, Contact access and at the end event Google Maps. It may have been hard to follow for people not accustomed to Android and wasn’t all too in depth, but the overall idea most probably came through.

I’ll write some Android App for sure in some time – first I’ll have to quickly finish my GWT-Crossword… It’ll probably be a ContactMerger – something that’s clearly missing in all google apps and is constantly nagging me. That is, an app to easily merge contact duplicates into one contact. This could be really nicely automated, and when some conflicts are detected a normal 3-diff-like dialog would be enough to quickly merge a few contacts into one… Sadly my HTC Hero still has the uber-old Android 1.5 and the contact’s access API has significantly changed since then… I think that by the time I’m ready to code for android  the 2.1 ROM Upgrade for my Phone should be available… So I’m focusing just on the “Level 7″ API (“level 7″ means “android 2.1″, whereas “level 3″ means “android 1.5″).

Piotr Maj – “Jak czerpać przyjemność z programowania w świecie krótkich terminów i parcia na słupki”

This presentation really stood outfrom the rest, it was fun and while not really tech focused, quite interesting. Piotr started out with some awesome [plastelina] figures that his wife made esspecially for this presentation: a “Garniturek” (Marketing Guy), an Programmer and an Evil Looking Tester. The figures were really hilarious… :-) Anyways, he started out with showing sources of [depresion] bad feelings in our day to day jobs, and pointing out that if we do something again and again, and still are doing it the same way – something’s not right, we don’t evolve if we code like that… Then he went on with introducing the Tester figure and some scenarios of a Tester humiliating Programmers. A few words about Selenium and then we were talking about how writing tests it both necessary and potentially really interesting. So in the end, we ended up talking about Unit/Functional Testing and Test Coverage – who would have thought, by the title of the presentation I was expecting something else, but it was a really plesant presentation nonetheless, and the need of testing code can’t be stressed enough I guess – maybe I’ll start to have a major test coverage of my code thanks this constant nagging about them ;-)

Pizza Time

During the pizza-break we had a long talk with Miroslav, and people could play around with the Nexus One he brought especially for this presentation. It’s interesting to hear out other developers views on some API. I for example find the Android API quite nice. The “J2ME Hell” I have been coding some stuff for burns even fiercer now that I have the option to choose another Mobile Java Platform – at last with cool things like SQLite, Widgets and Easy Touch Responsiveness – oh an the BackGroundTasking is a great feature – something J2ME never had I think, on the other hand, what good stuff did basic J2ME have? Yeah there were some JSRs that made life not so painful on ME, but on most of my phones there always were problems with them – MMAPI for example, where you sometimes had to code something SE or NOKIA specific – so where is that “write once” gone on ME eh…? Later on we talked with Miroslav and it seems that he’ll be at our SFI next month – yet another great conference… :-)

One of the developers had an Motorola DROID, which I have considered buying but decided for the HERO – for money reasons… The DROID’s (MILESTONE’s) phicical keyboard really sucks, by the way. That, plus the fact of how awesome the on-screen-keyboard of Android is made me not regret buying a phone without phisical keyboard… ;-)

Marcin Kalas – “Java/JEE Performance Test Planning – How To Plan Successful Performance Tuning of Java/JEE applications”

I had really high hopes for this presentation, as I’m currently doing JMeter Load Testing on MySQL engines at my University. Sadly this wasn’t a “practical” or “hands-on” presentation. Yeah, I understand that it’s really hard to show this kind of stuff in such a short period of time, nonetheless I hoped for some more “tricks and advices”. The some tips about the JVM and multiple GC Strategries were quite interesting, but that’s something I’ll need to lookup and read about when I’m going to need it as it’s clearly a very big topic.

Marcin surely has a lot of experience in performance tuning apps that’s clear and it was really interesting to see some people (Java Gurus) from the audience throw some interesting stuff into the presentation. Real JEE apps are really something amazing, I hope I’ll be able to code and work with such apps in my future, it’s an amazing world full of Gigantic DataCenters and Techniques no small app would ever find any use for… For now I’ll have to get good at the basic stuff I guess, I’ve still got some time. What I found very interesting were the Load/Stress “Patterns” Marcin displayed. For example if your application is always busy, or strangely idle – even with lots of request’s comming in etc. It’s something that really makes you think about the app/server and bottlenecks… Sadly I can’t seem to find anything similar about those online – maybe I’m just not searching well enough. I hope to see some of those behaviours while testing our databases, we don’t have multiple application layers in these tests and finding bottlenecks should be easy – it should be, right? ;-) Anyway, I hope to have some fun experiments with our mini-server.

GeeCON 2010

The whole event was also a small GeeCON campain. People got some stickers and [smycze] with GeeCON branding. I’m planing to go there as it seems like an very amazing event… This year it’s in Poznań, and it’s being organized with cooperation of the Poznań and Polish JUGs. I’ll keep you up to date about upcomming Java Events – the next being SFI and then *something special* in April :-) Well then… “Let’s move the Java World!”

I’m coding this project to get used to some of the basic JEE stuff, such as Hibernate for example (it is quite amazing and very elegant – especially HQL), and to have a good time while coding in Java…

The source is avaiable under the AGPLv3 on github: http://github.com/ktoso/gwt-crossword
At some places it is still a mess so please keep in mind that it’s still under initial development (and I’m having a tough time at the uni and can’t code gwt-crossword everyday :\), that aside, feel free to take a look on the source!

:syntax on

Whoa, 2 words, not 2 letters like usually! Thats pretty long for vim ain’t it? ;-)