Questions tagged [unix-timestamp]

The number of seconds between a particular date and the Unix Epoch on January 1st, 1970

POSIX definition

The POSIX.1 definition of Unix time is a number which is zero at the Unix epoch (1970-01-01T00:00:00Z), and increases by exactly 86 400 per day. Epoch and day ordinals are based on UTC.

The subtlety in this definition comes from the fact that days aren't exactly 86 400 seconds long. POSIX timestamps grow at 1Hz during the day, then end the day with small jumps to adjust for the duration of the UTC day.

For example, 2004-09-16T00:00:00Z, 12 677 days after the epoch, is represented by the Unix time number 12 677 × 86 400 = 1 095 292 800. The time interval between the epoch and 2004-09-16T00:00:00Z actually lasted 12 677 × 86 400 + 22 seconds.

This definition can be extended to represent instants before the epoch using negative numbers. 1957-10-04T00:00:00Z, 4 472 days before the epoch, is represented by the Unix time number -4 472 × 86 400 = -386 380 800. UTC is not defined for these instants, but universal time (any time standard that counts days from midnight at the reference meridian, such as the Julian Day) can be used, and the reduced accuracy is unlikely to matter.

POSIX provides for sub-second resolution with struct timespec, a fixed point format with a tv_nsec struct member for nanoseconds. This format is useful for system interfaces, but unsuitable for serialisation (naive range-checking could leave holes).

POSIX timestamps are ambiguous, discontinuous, and non-monotonic across leap seconds. When a leap second is inserted, a 1s range of Unix timestamps is repeated, first representing the leap second, then representing the first second of the next day (some implementations repeat the timestamp range immediately before the leap second instead). In the theoretical case of negative leap seconds, there would be 1s ranges of Unix time that do not represent any instant in time. The rest of the time, these Unix timestamps are continuous, unambiguous, and grow monotonically by 1s every second. The ambiguity isn't introduced by UTC, which measures time broken down in components and not as a single number.

System timestamps

On Unix systems, the CLOCK_REALTIME clock represents Unix time on a best-effort basis, based on hardware and network support. It may jump if the system clock is too far from reference time. Different clocks, representing different notions of system time, are exposed through clock_gettime. On Linux, CLOCK_MONOTONIC is monotonic and continuous (with no time elapsing when the system is suspended). It may speed up or slow down when adjtime is called, typically through NTP steering (clock slew). CLOCK_BOOTTIME is also monotonic, but will continue growing when the system is suspended. CLOCK_MONOTONIC_RAW is like CLOCK_MONOTONIC, but matches the speed of the hardware clock and ignores adjtime adjustments to clock speed. CLOCK_PROCESS_CPUTIME_ID and CLOCK_THREAD_CPUTIME_ID count CPU time consumed by the process and thread, respectively. Linux also provides coarse variants that may provide better performance.

Timestamps recorded by the kernel (for example, modification times on filesystem inodes) follow the CLOCK_REALTIME clock.

Assuming CLOCK_REALTIME follows POSIX time, getting unambiguous time (UTC or TAI) from the kernel is an unsolved problem; adjtimex might expose enough internal state but it is highly implementation dependent. Breaking from the standard brings its own tradeoffs.

Alternative timestamps

POSIX.1b-1993 switched the definition of Unix timestamps away from a simple second count from the epoch. This introduced a few drawbacks: timestamps do not represent instants unambiguously, and Unix time is discontinuous and jumps backwards. The jumps are rare, thus hard to test for. Bugs can be subtle and are most likely to be discovered in production, after developers have moved on.

TAI-10 (TAI minus ten seconds) hits midnight at the Unix epoch. TAI is an ideal timestamp format; it grows perfectly linearly at 1/s.

Redefining CLOCK_REALTIME to follow an alternative to POSIX time is doable, but not advisable unless you control the system entirely. Setting the clock to TAI-10, applications that use localtime will still work, with /etc/localtime pointing to the Olson "right" timezones, but many applications expect to compute UTC days from timestamp / 86_400. Redefining CLOCK_REALTIME indirectly, through a tweaked NTP server, is more feasible; many applications will survive slightly varying clock speeds. This is the leap smear technique, which silently replaces UTC with UTC-SLS (smoothed leap seconds).

Other proposals aim to extend the clock_gettime interface instead of replacing the default clock. One is CLOCK_UTC, which encodes the leap second by growing tv_nsec beyond the [0, NSEC_PER_SEC] range, removing the ambiguity of CLOCK_REALTIME. The other is CLOCK_TAI, which simply encodes TAI.

time_t binary representation

ABIs where time_t is 32 bits are unable to represent times beyond January 2038; their timestamps will jump into the early twentieth century instead. This will prove a problem for some embedded systems that are being deployed now. clock_gettime/timespec_get, 64 bit integers, or other fixed-point formats like TAI64 should be used instead.

Use in protocols and serialisation

Unix timestamps are sometimes persisted, for example through serialisation or archive formats. Most filesystems use them for inode metadata. Internet protocols and formats systematically prefer RFC 3339/ISO 8601 datetimes. The SQL timestamp type is a Unix timestamp; when (fixed-offset) timezones are used, naive datetimes are translated to UTC at the storage boundary. TAI64 has been proposed to address the interoperability shortcomings of POSIX timestamps (and of time_t). When the extra compactness of integers isn't required, RFC 3339 UTC datetimes are self-describing and provide better portability, readability and widespread support.

2326 questions
0
votes
3 answers

PHP wrong unix timestamp

find some problem when i was try to count days between two dates. For fast debug my code i use http://sandbox.onlinephpfunctions.com/ with PHP version 7.4.0 Problem: $date = new DateTime( '2018-02-28' ); $date2 = new DateTime( '2018-03-12' ); $diff…
0
votes
1 answer

String dates into unixtime in a pandas dataframe

i got dataframe with column like this: Date 3 mins 2 hours 9-Feb 13-Feb the type of the dates is string for every row. What is the easiest way to get that dates into integer unixtime ?
0
votes
3 answers

How to fix the bellow code that is meant to add minutes to timestamp and final value should be also in timestamp as I will do some database queries?

var startDate = 1582530967; var intervalDate = moment(new Date(startDate)).add(30, 'minutes').toDate().valueOf() console.log(intervalDate); The above codes makes bug adding 30 minutes makes it Monday, March 16, 2020 5:56:07 AM GMT+02:00
user12423529
0
votes
1 answer

Converting e.timeStamp into the current date/time?

I've set an event listner on an 'li' element which contains a span element that should output the current date. I have the following lines of code: var date = new Date(); date.setTime(e.timeStamp); var showDate =…
Manny D
  • 19
  • 5
0
votes
1 answer

Convert UTC timestamp to yyyyMMddHHmmss.SSS format in hive

I have a scenario like below in hive convert the current_timestamp to UTC. I am able to do so select to_utc_timestamp(current_timestamp, 'America/Los_Angeles)'; Result: 2020-02-04 10:00:06.162 Next convert this resulting timestamp to…
nmr
  • 605
  • 6
  • 20
0
votes
2 answers

How to check if equals or is within X days in MySQL query?

I have a column called submit_timestamp which holds a UNIX_TIMESTAMP(), what I want to do now is do a SELECT query and within the WHERE clause ensure the submit_timestamp equals or is within X number of days. (Demonstration purposes only): SELECT…
newbtophp
  • 175
  • 2
  • 10
0
votes
1 answer

Group By Date Timestamp MySQL

I've got the following query on a timestamp(specified by INT(10), which kind of does what I want, but not exactly: SELECT count(entry_date) as theCount, FROM_UNIXTIME(entry_date, '%Y-%m-%d') AS dd FROM exp_weblog_titles WHERE entry_date <…
Macgyver
  • 1,831
  • 2
  • 16
  • 19
0
votes
1 answer

Convert unix_timestamp to utc_timestamp using pyspark, unix_timestamp not working

I have a string column that has unix_tstamp in a pyspark dataframe. unix_tstamp utc_stamp 1547741586462 2019-01-17 16:13:06:462 1547741586562 2019-01-17 16:13:06:562 1547741586662 2019-01-17 16:13:06:662 1547741586762 …
0
votes
1 answer

In Pine Script, how can you do something once per day, or keep track if something has been done yet that day?

I'm working on a TradingView script (Pine) and i'm trying to use my Daily-bar strategy on the 5-minute chart. To do this, I need to basically only check conditions once per day. I can do this by having a boolean variable such as dailyCheck =…
Wayne Filkins
  • 317
  • 1
  • 5
  • 14
0
votes
4 answers

MySQL: Converting time and date to unix timestamp

How can I convert strings holding some time and date in plain format, e.g. 20:21:14 - 21/01/2020 to a unix timestamp format, e.g.1579638074 in SQL? Thanks
Cosmin
  • 1
  • 5
0
votes
1 answer

Specify Epoch TimeDate Format when serializing/deserializing with Utf8Json

i couldn't find enough informations about howto handle DateTimeOffset and TimeSpan during serializing and deserializing with utf8json. i could find Infos about the IJsonFormatter, but not howto implement it correctly.. My example Class looks like…
biohell
  • 304
  • 3
  • 14
0
votes
0 answers

Covert specific Time to different TIMEZONE in UNIX KSH script

I want to convert specific/Input date to different timezone. I have tried below code. dateYMD="2019/2/28 12:23:11.46" timesydney=$(TZ=Australia/Sydney date -d "$dateYMD" +%s) But above code give me a below error.... date: Not a recognized flag:…
Mehul
  • 13
  • 4
0
votes
0 answers

How to get start value with Year in Unix/Linux command or any other way python also fine?

i need output with Year in start field, below command i am using in Linux to get the License details but i am getting date like(start Tue 1/7 9:54) , so want to know the year for this: lmutil lmstat -a -c user@server_name -f abcd -t Output : start…
0
votes
0 answers

Get 1 month ago from a particular date

I need to find 1 month ago from a particular date. But for months with 31 days, I'm getting in-correct date as the output For example, in the scenario below I should have got 20191130, but I got 20191201 as the…
0
votes
0 answers

Js Date - Unix Time Stamp wrong result

Hi I have generated a Unix Time Stamp with an online generator and I choose that Date: 01/12/2020 @ 9:30pm (UTC) Which gave me result: 1578864600 I want to display it now in my react app: (date is my result above) const timestamp = new…
Freestyle09
  • 4,894
  • 8
  • 52
  • 83
1 2 3
99
100