Using GQL to get all new results since the previous result

Question

I'm pretty useless when it comes to queries, I'm wondering what's the correct structure for this problem.

Clients are sent data including the key of the object, they use the key to tell the server what was the most recent object they downloaded.

I want to get all objects since that point, the objects have an automatic date attribute.

Additionally, I want to be able to give the 15 (or so) most recent objects to new users who may request using a specific 'new user' key or something similar.

Using the Python2.7 runtime, never used GQL before,

Any help is greatly appreciated.

The Model Class is this:

class Message(db.Model):
    user = db.StringProperty()
    content = db.TextProperty()
    colour = db.StringProperty()
    room = db.StringProperty()
    date = db.DateTimeProperty(auto_now_add=True)

You'd sort your query based on the field name of the automatic date attribute, can you post your model definition? the query would like something like `select * from WHERE > order by asc`. would be the date of the last object they downloaded. — someone1, Mar 13 '13 at 18:18
Thanks, how do I get the date from the key? `lastdate = Message.get_by_id(int(lastkey)).date` doesn't seem to work — monkeymad2, Mar 13 '13 at 22:26

someone1 · Accepted Answer · 2013-03-14T03:07:05.927

If it is a db.Key object or a string representation of a key using the db (as opposed to the ndb) API:

last_message = Message.get(lastkey)

If you have the key in another representation, such as the key name:

last_message = Message.get_by_key_name(lastkey)

If you have the key as the numeric ID of the object:

last_message = Message.get_by_id(int(lastkey))

Then, you can get the messages since that last message as follows:

messages_since_last_message = Message.all().filter('date >', last_message.date).order('date')
#OR GQL:
messages_since_last_message = Message.gql("WHERE date > :1 ORDER BY date ASC", last_message.date)

You should maybe use the >= comparator only because there may be multiple messages that arrive at the same exact time, and then filter out all messages that are in the list up to and including the last key you are looking for (this actually depends on your use case and how closely message could be written). Additionally, with the High Replication datastore, there is eventual consistency, so your query is not guaranteed to accurately reflect the datastore unless you use ancestor queries, in which case you limit your entity group to ~1 write per second, which again, depending on your use case, could be a non-issue. The Entity Group here reflects the parent model and all of its children ancestors. The group of ancestors resides on a single entity group.

Using GQL to get all new results since the previous result

1 Answers1