{"id":3779,"date":"2017-11-09T09:59:22","date_gmt":"2017-11-09T00:59:22","guid":{"rendered":"https:\/\/happypanter.wordpress.com\/?p=3779"},"modified":"2017-11-09T09:59:22","modified_gmt":"2017-11-09T00:59:22","slug":"straight-through-estimator","status":"publish","type":"post","link":"http:\/\/hireido.blogsite.org\/wptiger\/archives\/3779","title":{"rendered":"Straight-Through Estimator"},"content":{"rendered":"<p>Straight-Through Estimator\u304c\u5206\u304b\u3089\u306a\u304b\u3063\u305f\u306e\u3067\u8abf\u3079\u3066\u307f\u305f\uff0e<a href=\"http:\/\/hirotaka-hachiya.hatenablog.com\/entry\/2016\/08\/07\/210016\" target=\"_blank\" rel=\"noopener\">\u516b\u8c37\u5927\u5cb3\u306e\u899a\u3048\u66f8\u304d\u30d6\u30ed\u30b0<\/a>\u306b\u306f<\/p>\n<p>\u201d\u7d76\u5bfe\u5024\u304c1\u4ee5\u4e0b\u306e\u52fe\u914d\u306e\u307f\u7528\u3044\u3066\u66f4\u65b0\u3059\u308b\u201d<\/p>\n<p>\u3068\u3042\u308b\uff0e<a href=\"https:\/\/www.quora.com\/What-is-the-concept-of-straight-through-estimator-STE-in-neural-networks\" target=\"_blank\" rel=\"noopener\">Quora<\/a>\u306b\u306f<\/p>\n<p>you just estimate that the incoming gradient to a thresholder is equal to the outgoing gradient.<\/p>\n<p>\u3068\u3042\u308b\uff0e\u3053\u306e\u4e8c\u3064\u304c\u540c\u3058\u3053\u3068\u3092\u8a00\u3063\u3066\u3044\u308b\u3068\u3059\u308b\u3068\uff0c\u30d0\u30c3\u30af\u30d7\u30ed\u30d1\u30b2\u30fc\u30b7\u30e7\u30f3\u306e\u3068\u304d\u306b\u4e0a\u6d41\u304b\u3089\u6d41\u308c\u3066\u304f\u308b\u52fe\u914d\u306f+1\u3068-1\uff08\u30680\u3082\u304b?\uff09\u3067\uff0c\u305d\u308c\u3092\u305d\u306e\u307e\u307e\u4e0b\u6d41\u306b\u6d41\u3059\u3068\u3044\u3046\u3053\u3068\u306b\u306a\u308b\uff0e\u3046\u30fc\u3080\uff0c\u5143\u306e\u6587\u732e\uff08\u30d3\u30c7\u30aa\uff09\u3092\u898b\u3066\u3082\u306f\u3063\u304d\u308a\u5206\u304b\u3089\u306a\u3044\uff0e\u3069\u3046\u3059\u308a\u3083\u3044\u3044\u306e\u3088\uff0e<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Straight-Through Estimator\u304c\u5206\u304b\u3089\u306a\u304b\u3063\u305f\u306e\u3067\u8abf\u3079\u3066\u307f\u305f\uff0e\u516b\u8c37\u5927\u5cb3\u306e\u899a\u3048\u66f8\u304d\u30d6\u30ed\u30b0\u306b\u306f \u201d\u7d76\u5bfe\u5024\u304c1\u4ee5\u4e0b\u306e\u52fe\u914d\u306e\u307f\u7528\u3044\u3066\u66f4\u65b0\u3059\u308b\u201d \u3068\u3042\u308b\uff0eQuora\u306b\u306f you just estimate that the incoming gradient to a [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[49],"tags":[],"_links":{"self":[{"href":"http:\/\/hireido.blogsite.org\/wptiger\/wp-json\/wp\/v2\/posts\/3779"}],"collection":[{"href":"http:\/\/hireido.blogsite.org\/wptiger\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/hireido.blogsite.org\/wptiger\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/hireido.blogsite.org\/wptiger\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/hireido.blogsite.org\/wptiger\/wp-json\/wp\/v2\/comments?post=3779"}],"version-history":[{"count":0,"href":"http:\/\/hireido.blogsite.org\/wptiger\/wp-json\/wp\/v2\/posts\/3779\/revisions"}],"wp:attachment":[{"href":"http:\/\/hireido.blogsite.org\/wptiger\/wp-json\/wp\/v2\/media?parent=3779"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/hireido.blogsite.org\/wptiger\/wp-json\/wp\/v2\/categories?post=3779"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/hireido.blogsite.org\/wptiger\/wp-json\/wp\/v2\/tags?post=3779"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}